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Preface 


This book covers calculus in two and three variables. It is suitable for a one-semester course, 
normally known as “Vector Calculus”, “Multivariable Calculus", or simply “Calculus IIT". 
The prerequisites are the standard courses in single-variable calculus (a.k.a. Calculus I and 
ID. 

I have tried to be somewhat rigorous about proving results. But while it is important for 
students to see full-blown proofs - since that is how mathematics works - too much rigor and 
emphasis on proofs can impede the flow of learning for the vast majority of the audience at 
this level. If I were to rate the level of rigor in the book on a scale of 1 to 10, with 1 being 
completely informal and 10 being completely rigorous, I would rate it as a 5. 

There are 420 exercises throughout the text, which in my experience are more than 
enough for a semester course in this subject. There are exercises at the end of each sec- 
tion, divided into three categories: A, B and C. The A exercises are mostly of a routine 
computational nature, the B exercises are slightly more involved, and the C exercises usu- 
ally require some effort or insight to solve. A crude way of describing A, B and C would be 
“Easy”, “Moderate” and “Challenging”, respectively. However, many of the B exercises are 
easy and not all the C exercises are difficult. 

There are a few exercises that require the student to write his or her own computer pro- 
gram to solve some numerical approximation problems (e.g. the Monte Carlo method for 
approximating multiple integrals, in Section 3.4). The code samples in the text are in the 
Java programming language, hopefully with enough comments so that the reader can figure 
out what is being done even without knowing Java. Those exercises do not mandate the use 
of Java, so students are free to implement the solutions using the language of their choice. 
While it would have been simple to use a scripting language like Python, and perhaps even 
easier with a functional programming language (such as Haskell or Scheme), Java was cho- 
sen due to its ubiquity, relatively clear syntax, and easy availability for multiple platforms. 

Answers and hints to most odd-numbered and some even-numbered exercises are pro- 
vided in Appendix A. Appendix B contains a proof of the right-hand rule for the cross prod- 
uct, which seems to have virtually disappeared from calculus texts over the last few decades. 
Appendix C contains a brief tutorial on Gnuplot for graphing functions of two variables. 

This book is released under the GNU Free Documentation License (GFDL), which allows 
others to not only copy and distribute the book but also to modify it. For more details, see 
the included copy of the GFDL. So that there is no ambiguity on this matter, anyone can 
make as many copies of this book as desired and distribute it as desired, without needing 
my permission. The PDF version will always be freely available to the public at no cost 
(go to http://www.mecmath.net). Feel free to contact me at mcorral@schoolcraft.edu for 


ili 


iv Preface 


any questions on this or any other matter involving the book (e.g. comments, suggestions, 


corrections, etc). I welcome your input. 
Finally, I would like to thank my students in Math 240 for being the guinea pigs for the 
initial draft of this book, and for finding the numerous errors and typos it contained. 


January 2008 MICHAEL CORRAL 


Contents 


Preface 


1 


Vectors in Euclidean Space 


1.1 Introduction... 
1.2 Vector Algebra . 
1.3 Dot Product ... 
1.4 Cross Product. . 
1.5 Lines and Planes 
1.6 Surfaces ..... 


1.7 Curvilinear Coordinates. .......... e 
1.8 Vector-Valued Functions .......... es 


19 ArcLength.... 


Functions of Several Variables 

2.1 Functions of Two or Three Variables .............. llle. 
2.2. .Partial. Derivatives 5 i o a ARRA du Aui AV I qat 
2.3 TangentPlanetoaSurface. ....... ea i ORE R lle 
2.4 Directional Derivatives and the Gradient .................... lr. 
2.5 Mazima and Minima ........................ les 


2.6 Unconstrained Optimization: Numerical Methods.................. 
2.7 Constrained Optimization: Lagrange Multipliers .................. 


Multiple Integrals 
3.1 Double Integrals 


3.2 Double Integrals Over a General Region. ................ 000000 


3.3 Triple Integrals . 


3.4 Numerical Approximation of Multiple Integrals ................... 
3.5 Change of Variables in Multiple Integrals .................... ln. 
3.6 Application: Center of Mass ............. ee eee 
3.7 Application: Probability and Expected Value .................. ln. 


Line and Surface Integrals 


4.1 Line Integrals. . 


4.2 Properties of Line Integrals ................. eee eee eee 


4.3 Green's Theorem 


vi Contents 


4.4 Surface Integrals and the Divergence Theorem.................... 
4.5 Stokes Theorem .......... 0... ee ee 


Bibliography 

Appendix A: Answers and Hints to Selected Exercises 
Appendix B: Proof of the Right-Hand Rule for the Cross Product 
Appendix C: 3D Graphing with Gnuplot 

GNU Free Documentation License 

History 


Index 


1 Vectors in Euclidean Space 


1.1 Introduction 


In single-variable calculus, the functions that one encounters are functions of a variable 
(usually x or £) that varies over some subset of the real number line (which we denote by R). 
For such a function, say, y = f (x), the graph of the function f consists of the points (x, y) = 
(x, f (x)). These points lie in the Euclidean plane, which, in the Cartesian or rectangular 
coordinate system, consists of all ordered pairs of real numbers (a,b). We use the word 
“Euclidean” to denote a system in which all the usual rules of Euclidean geometry hold. We 
denote the Euclidean plane by R?; the “2” represents the number of dimensions of the plane. 
The Euclidean plane has two perpendicular coordinate axes: the x-axis and the y-axis. 

In vector (or multivariable) calculus, we will deal with functions of two or three variables 
(usually x, y or x,y,z, respectively). The graph of a function of two variables, say, z = f (x, y), 
lies in Euclidean space, which in the Cartesian coordinate system consists of all ordered 
triples of real numbers (a,b,c). Since Euclidean space is 3-dimensional, we denote it by R?. 
The graph of f consists of the points (x,y,z) = (x, y, f(x, y)). The 3-dimensional coordinate 
system of Euclidean space can be represented on a flat surface, such as this page or a black- 
board, only by giving the illusion of three dimensions, in the manner shown in Figure 1.1.1. 
Euclidean space has three mutually perpendicular coordinate axes (x, y and z), and three 
mutually perpendicular coordinate planes: the xy-plane, yz-plane and xz-plane (see Figure 
1.1.2). 


yz-plane 


Figure 1.1.1 Figure 1.1.2 
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The coordinate system shown in Figure 1.1.1 is known as a right-handed coordinate 
system, because it is possible, using the right hand, to point the index finger in the positive 
direction of the x-axis, the middle finger in the positive direction of the y-axis, and the thumb 
in the positive direction of the z-axis, as in Figure 1.1.3. 
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Figure 1.1.3 Right-handed coordinate system 


An equivalent way of defining a right-handed system is if you can point your thumb up- 
wards in the positive z-axis direction while using the remaining four fingers to rotate the 
x-axis towards the y-axis. Doing the same thing with the left hand is what defines a left- 
handed coordinate system. Notice that switching the x- and y-axes in a right-handed 
system results in a left-handed system, and that rotating either type of system does not 
change its “handedness”. Throughout the book we will use a right-handed system. 

For functions of three variables, the graphs exist in 4-dimensional space (i.e. Rt), which 
we can not see in our 3-dimensional space, let alone simulate in 2-dimensional space. So 
we can only think of 4-dimensional space abstractly. For an entertaining discussion of this 
subject, see the book by ABBOTT.! 

So far, we have discussed the position of an object in 2-dimensional or 3-dimensional space. 
But what about something such as the velocity of the object, or its acceleration? Or the 
gravitational force acting on the object? These phenomena all seem to involve motion and 
direction in some way. This is where the idea of a vector comes in. 


lOne thing you will learn is why a 4-dimensional creature would be able to reach inside an egg and remove the 
yolk without cracking the shell! 
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You have already dealt with velocity and acceleration in single-variable calculus. For 
example, for motion along a straight line, if y = f(t) gives the displacement of an object after 
time t, then d y/dt = f '(t) is the velocity of the object at time t. The derivative f '(t) is just a 
number, which is positive if the object is moving in an agreed-upon “positive” direction, and 
negative if it moves in the opposite of that direction. So you can think of that number, which 
was called the velocity of the object, as having two components: a magnitude, indicated 
by a nonnegative number, preceded by a direction, indicated by a plus or minus symbol 
(representing motion in the positive direction or the negative direction, respectively), i.e. 
f ' (t) = +a for some number a = 0. Then a is the magnitude of the velocity (normally called 
the speed of the object), and the + represents the direction of the velocity (though the + is 
usually omitted for the positive direction). 

For motion along a straight line, i.e. in a 1-dimensional space, the velocities are also con- 
tained in that 1-dimensional space, since they are just numbers. For general motion along a 
curve in 2- or 3-dimensional space, however, velocity will need to be represented by a multi- 
dimensional object which should have both a magnitude and a direction. A geometric object 
which has those features is an arrow, which in elementary geometry is called a "directed line 
segment". This is the motivation for how we will define a vector. 


Definition 1.1. A (nonzero) vector is a directed line segment drawn from a point P (called 
its initial point) to a point Q (called its terminal point), with P and Q being distinct 


points. The vector is denoted by PQ. Its magnitude is the length of the line segment, 
denoted by |PQ ||, and its direction is the same as that of the directed line segment. The 
zero vector is just a point, and it is denoted by 0. 


To indicate the direction of a vector, we draw an arrow from its initial point to its terminal 
point. We will often denote a vector by a single bold-faced letter (e.g. v) and use the terms 
“magnitude” and “length” interchangeably. Note that our definition could apply to systems 
with any number of dimensions (see Figure 1.1.4 (a)-(c)). 
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Figure 1.1.4 Vectors in different dimensions 
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A few things need to be noted about the zero vector. Our motivation for what a vector is 
included the notions of magnitude and direction. What is the magnitude of the zero vector? 
We define it to be zero, i.e. ||0]| 2 O0. This agrees with the definition of the zero vector as just 
a point, which has zero length. What about the direction of the zero vector? A single point 
really has no well-defined direction. Notice that we were careful to only define the direction 
of a nonzero vector, which is well-defined since the initial and terminal points are distinct. 
Not everyone agrees on the direction of the zero vector. Some contend that the zero vector 
has arbitrary direction (i.e. can take any direction), some say that it has indeterminate 
direction (i.e. the direction can not be determined), while others say that it has no direction. 
Our definition of the zero vector, however, does not require it to have a direction, and we will 
leave it at that.? 

Now that we know what a vector is, we need a way of determining when two vectors are 
equal. This leads us to the following definition. 


Definition 1.2. Two nonzero vectors are equal if they have the same magnitude and the 


same direction. Any vector with zero magnitude is equal to the zero vector. 


By this definition, vectors with the same magnitude and direction but with different initial 
points would be equal. For example, in Figure 1.1.5 the vectors u, v and w all have the same 
magnitude v5 (by the Pythagorean Theorem). And we see that u and w are parallel, since 
they lie on lines having the same slope i, and they point in the same direction. So u = w, 
even though they have different initial points. We also see that v is parallel to u but points 
in the opposite direction. So u Z v. 
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Figure 1.1.5 


So we can see that there are an infinite number of vectors for a given magnitude and 
direction, those vectors all being equal and differing only by their initial and terminal points. 
Is there a single vector which we can choose to represent all those equal vectors? The answer 
is yes, and is suggested by the vector w in Figure 1.1.5. 


?In the subject of linear algebra there is a more abstract way of defining a vector where the concept of *direction" 
is not really used. See ANTON and RORRES. 
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Unless otherwise indicated, when speaking of “the vector" with a given magnitude and 
direction, we will mean the one whose initial point is at the origin of the coordinate 


system. 


Thinking of vectors as starting from the origin provides a way of dealing with vectors in 
a standard way, since every coordinate system has an origin. But there will be times when 
it is convenient to consider a different initial point for a vector (for example, when adding 
vectors, which we will do in the next section). 

Another advantage of using the origin as the initial point is that it provides an easy cor- 
respondence between a vector and its terminal point. 


Example 1.1. Let v be the vector in R? whose initial point is at the origin and whose ter- 
minal point is (3,4,5). Though the point (3,4,5) and the vector v are different objects, it is 
convenient to write v = (3,4,5). When doing this, it is understood that the initial point of v 
is at the origin (0,0,0) and the terminal point is (3,4,5). 


P(3,4,5) 
e. 


x 


(a) The point (3,4,5) (b) The vector (3,4,5) 


Figure 1.1.6 Correspondence between points and vectors 


Unless otherwise stated, when we refer to vectors as v = (a,b) in R? or v = (a,b,c) in R?, 
we mean vectors in Cartesian coordinates starting at the origin. Also, we will write the zero 
vector 0 in R? and R as (0,0) and (0,0,0), respectively. 

The point-vector correspondence provides an easy way to check if two vectors are equal, 
without having to determine their magnitude and direction. Similar to seeing if two points 
are the same, you are now seeing if the terminal points of vectors starting at the origin 
are the same. For each vector, find the (unique!) vector it equals whose initial point is 
the origin. Then compare the coordinates of the terminal points of these ^new" vectors: if 
those coordinates are the same, then the original vectors are equal. To get the ^new" vectors 
starting at the origin, you translate each vector to start at the origin by subtracting the 
coordinates of the original initial point from the original terminal point. The resulting point 
will be the terminal point of the ^new" vector whose initial point is the origin. Do this for 
each original vector then compare. 
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Example 1.2. Consider the vectors PQ and RS in R?, where P = (2,1,5),Q = (3,5,7),R = 


(1,-3,-2) and S = (2, 1,0). Does PQ = RS? 
Solution: The vector PQ is equal to the vector v with initial point (0,0,0) and terminal point 


Q -P =(3,5,7)-(2,1,5)= (3 - 2,5- 1,7 — 5) = (1,4,2). 
Similarly, RS is equal to the vector w with initial point (0,0,0) and terminal point S — R = 


(2,1,0) (1,-3,-2) = (2 1,1 (-3),0 - (-2)) = (1,4,2). 
So PQ = v - (1,4,2) and RS = w = (1,4,2). 
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Figure 1.1.7 


Recall the distance formula for points in the Euclidean plane: 


For points P = (x1, y1), Q = (x5, y2) in R?, the distance d between P and Q is: 


d = /(x; x1)? + (y, — y? 


By this formula, we have the following result: 


For a vector PQ in R? with initial point P = (x;, yı) and terminal point 


Q = (x5, Y2), the magnitude of PQ is: 
|. P9 | = VG; 7x Gs 7 y)? 
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Finding the magnitude of a vector v = (a,b) in R? is a special case of formula (1.2) with 
P = (0,0) and Q = (a,b): 


For a vector v = (a,b) in R2, the magnitude of v is: 


lvl = va? 4 5? 


To calculate the magnitude of vectors in R?, we need a distance formula for points in 
Euclidean space (we will postpone the proof until the next section): 


Theorem 1.1. The distance d between points P = (x1, y,,2;) and Q = (x2, Y2, Z2) in R is: 


d- (x, = x1)? + (y — y)? + (z3 = z1)? (1.4) 


The proof will use the following result: 


Theorem 1.2. For a vector v = (a,b,c) in R?, the magnitude of v is: 


lvl] = Va? + 52 4 c? 


Proof: There are four cases to consider: 


Case 1: a=b 2c 20. Then v20,so | v| = 0 = V0? +02 - 02 = Va? + b2 + c2. 


Case 2: exactly two of a,b,c are 0. Without loss of generality, we assume that a = b = 0 and 
c #0 (the other two possibilities are handled in a similar manner). Then v = (0,0,c), which 


is a vector of length |c| along the z-axis. So ||v|| = |c| = Vc? = V02 + 02 +c? = Va? +62 +c?. 


Case 3: exactly one of a,b,c is 0. Without loss of generality, we assume that a 20, b Z0 
and c # 0 (the other two possibilities are handled in a similar manner). Then v = (0,5,c), 


which is a vector in the yz-plane, so by the Pythagorean Theorem we have ||v|| = Vb? + c? = 
V0? + b? - c?2- Va? c b? + c?. 


Case 4: none of a,b,c are 0. Without loss of generality, we can as- 
sume that a,b,c are all positive (the other seven possibilities are 
handled in a similar manner). Consider the points P = (0,0,0), 
Q = (a,b,c), R = (a, 5,0), and S = (a,0,0), as shown in Figure 
1.1.8. Applying the Pythagorean Theorem to the right trian- 
gle APSR gives |PR|? = a2+6?. A second application of the 
Pythagorean Theorem, this time to the right triangle APQR, 
gives | vl = IPQI = \/|PRI? - IQRP = Va2 +b? +c. 

This proves the theorem. QED Figure 1.1.8 


Q(a,b,c) 
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Example 1.3. Calculate the following: 


(a) The magnitude of the vector PQ in R? with P =(-1,2) and Q = (5,5). 
Solution: By formula (1.2), | PQ|| = /(5- (CD? + 6-2)? = V36+9 = V45 = 3v5. 


(b) The magnitude of the vector v = (8,3) in R?. 
Solution: By formula (1.3), || v|| = V82 + 32 = V73. 


(c) The distance between the points P = (2, —1,4) and Q = (4,2, -3) in R3. 
Solution: By formula (1.4), the distance d = y (4-— 2)2 + (2- (- 1? + (-8 — 4)? = 
vV44 9-49 = v62. 


(d) The magnitude of the vector v = (5,8, —2) in R?. 
Solution: By formula (1.5), || vl] = V52 + 82 + (-2)? = /25+644+4 = V93. 


1. Calculate the magnitudes of the following vectors: 
(a)v=(2,-1) (b) v=(2,-1,0) (c)v=(8,2,-2) (d)v=(0,0,1) (ev-(6,4,—4) 


A 


2. For the points P = (1,-1,1), Q =(2,-2,2), R = (2,0, 1), S = (3, 1,2), does PQ = RS? 
3. For the points P = (0,0,0), Q =(1,3,2), R = (1,0, 1), S = (2,3,4), does PQ = RS? 

B 

4. Let v=(1,0,0) and w = (a,0,0) be vectors in R?. Show that || wl — lalllvll. 

5. Let v = (a,b,c) and w = (3a,3b,3c) be vectors in R?. Show that || w]| = 3llv|. 

C 


6. Though we will see a simple proof of Theorem 1.1 
in the next section, it is possible to prove it using b. Y2, Z2) 
methods similar to those in the proof of Theorem PG 91,21) 

1.2. Prove the special case of Theorem 1.1 where the 
points P = (x1, y1, Z1) and Q = (x2, Y2, Z2) satisfy the fol- 
lowing conditions: 

0 
X > xı > 0, y > yı > 0, and z; > z, > 0. 531,31,0) 
(Hint: Think of Case 4 in the proof of Theorem 1.2, 
and consider Figure 1.1.9.) X — U(x,yi,0) 


PEE Xo, yo, 21) 


y 
» 


(x2, ya, 0) 


Figure 1.1.9 
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1.2 Vector Algebra 


Now that we know what vectors are, we can start to perform some of the usual algebraic 
operations on them (e.g. addition, subtraction). Before doing that, we will introduce the 
notion of a scalar. 


Definition 1.3. A scalar is a quantity that can be represented by a single number. 


For our purposes, scalars will always be real numbers? Examples of scalar quantities are 
mass, electric charge, and speed (not velocity). We can now define scalar multiplication of 
a vector. 


Definition 1.4. For a scalar k and a nonzero vector v, the scalar multiple of v by k, 
denoted by kv, is the vector whose magnitude is || || v||, points in the same direction as v if 


k > 0, points in the opposite direction as v if k < 0, and is the zero vector 0 if k = 0. For the 
zero vector 0, we define k0 = 0 for any scalar k. 


Two vectors v and w are parallel (denoted by v || w) if one is a scalar multiple of the other. 
You can think of scalar multiplication of a vector as stretching or shrinking the vector, and 
as flipping the vector in the opposite direction if the scalar is a negative number (see Figure 


1.2.1). 
/ / / DE | / 


Figure 1.2.1 


Recall that translating a nonzero vector means that the initial point of the vector is 
changed but the magnitude and direction are preserved. We are now ready to define the 
sum of two vectors. 


Definition 1.5. The sum of vectors v and w, denoted by v + w, is obtained by translating 
w so that its initial point is at the terminal point of v; the initial point of v + w is the initial 


point of v, and its terminal point is the new terminal point of w. 


3The term scalar was invented by 19th century Irish mathematician, physicist and astronomer William Rowan 
Hamilton, to convey the sense of something that could be represented by a point on a scale or graduated ruler. 
The word vector comes from Latin, where it means “carrier”. 

^An alternate definition of scalars and vectors, used in physics, is that under certain types of coordinate trans- 
formations (e.g. rotations), a quantity that is not affected is a scalar, while a quantity that is affected (in a 
certain way) is a vector. See MARION for details. 
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Intuitively, adding w to v means tacking on w to the end of v (see Figure 1.2.2). 


W, 
ee et 
v v v 
(a) Vectors v and w (b) Translate w to the end of v (c) The sum v * w 


Figure 1.2.2 Adding vectors v and w 


Notice that our definition is valid for the zero vector (which is just a point, and hence can 
be translated), and so we see that v+ 0 = v = 0+ v for any vector v. In particular, 0 +0 = 0. 
Also, it is easy to see that v - (Cv) = 0, as we would expect. In general, since the scalar 
multiple —v = —1v is a well-defined vector, we can define vector subtraction as follows: 
v—w=v+(—w). See Figure 1.2.3. 


v 
Ww v-w 
BN -w -Ww 
v 
(a) Vectors v and w (b) Translate —w to the end of v (c) The difference v -w 


Figure 1.2.3 Subtracting vectors v and w 


Figure 1.2.4 shows the use of *geometric proofs" of various laws of vector algebra, that is, 
it uses laws from elementary geometry to prove statements about vectors. For example, (a) 
shows that v + w = w + v for any vectors v, w. And (c) shows how you can think of v— w as 
the vector that is tacked on to the end of w to add up to v. 


(a) Add vectors (b) Subtract vectors (c) Combined add/subtract 


Figure 1.2.4 “Geometric” vector algebra 


Notice that we have temporarily abandoned the practice of starting vectors at the origin. 
In fact, we have not even mentioned coordinates in this section so far. Since we will deal 
mostly with Cartesian coordinates in this book, the following two theorems are useful for 
performing vector algebra on vectors in R? and R? starting at the origin. 
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Theorem 1.3. Let v = (v,,v,), wW = (w,,w;) be vectors in R?, and let k be a scalar. Then 
(a) kv = (kv,, kva) 


(b) v + w= (v; +.W,, 02+ w;) 


Proof: (a) Without loss of generality, we assume that v,,v, > 0 (the other possibilities are 
handled in a similar manner). If k = 0 then kv = 0v = 0 = (0,0) = (0u,, Ov.) = (kvi, kva), which 
is what we needed to show. If k 40, then (ku,,kv,) lies on a line with slope n = Em which 
is the same as the slope of the line on which v (and hence £v) lies, and (kv, kv) points in 
the same direction on that line as kv. Also, by formula (1.3) the magnitude of (kv,, kvo) is 


V (kvi)? + (Ruy)? = 4/ k2v2 + k2v2 = JJ k?(v2 + v2) = |k| / v2 +: v2 = |R| [|v]. So kv and (kv, kv») 


have the same magnitude and direction. This proves (a). 


(b) Without loss of generality, we assume that 


V2 + W2 
U1 U2,W1,W > O (the other possibilities are han- 
dled in a similar manner). From Figure 1.2.5, we we 
see that when translating w to start at the end of v9 
v, the new terminal point of w is (v, 4 w;,v; 4 W2), i 
so by the definition of v + w this must be the ter- 0 W1 Ui vi+tw -— 
minal point of v + w. This proves (b). QED Figure 1.2.5 


Theorem 1.4. Let v = (v,v,, 4), W = (w,,w5,w;) be vectors in R?, let k be a scalar. Then 
(a) kv = (kvi, kvs, kv;) 


(b) v + w= (v, w,,U; + W5,Us - Ws) 


The following theorem summarizes the basic laws of vector algebra. 


Theorem 1.5. For any vectors u, v, w, and scalars k,l, we have 
(a)v+w=wiv Commutative Law 


(b) u+(v+w)=(u+v)+w Associative Law 
(c) v-02 v20-v Additive Identity 
(d) v (-v)20 Additive Inverse 
(e) R(Iv) = (kl)v Associative Law 
(f) (v - w) kv - Ew Distributive Law 


(g) (k - Dv bv lv Distributive Law 


Proof: (a) We already presented a geometric proof of this in Figure 1.2.4(a). 

(b) To illustrate the difference between analytic proofs and geometric proofs in vector alge- 
bra, we will present both types here. For the analytic proof, we will use vectors in R? (the 
proof for R? is similar). 
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Let u = (U,, us, us), V = (v, Us, U3), W = (W1, W2, W3) be vectors in R?. Then 


ut (vtw) = (U, U2, us) + (Uy, Ve, Us) + (Wy, We, Ws)) 
= (U1, us, Us) + (U, + Wy, Vo + W2, U3 + W3) by Theorem 1.4(b) 
= (u,* (0 + wi), U2 + (05 + W2), Us +(V3 +W3)) by Theorem 1.4(b) 
= ((u, + U,) + w,, (Ug + v3) + We, (us *- v3) - w3) by properties of real numbers 
= (U +04, Ug + Ug, Ug + U3) + (Wy, We, W3) by Theorem 1.4(b) 


=(u+v)+w 


This completes the analytic proof of (b). Figure 1.2.6 provides the geometric proof. 


u+(v+w)=(u+v)+w 


V+W 


v 
Figure 1.2.6 Associative Law for vector addition 


(c) We already discussed this on p.10. 
(d) We already discussed this on p.10. 


(e) We will prove this for a vector v = (v,,v.2,V3) in R (the proof for IR? is similar): 


k(lv) = k(lv,,lvs, vs) by Theorem 1.4(a) 
= (Rlv,,klvs, klv;) by Theorem 1.4(a) 
= (hI)(v,, vs, v) by Theorem 1.4(a) 
=(kl)v 
(f) and (g): Left as exercises for the reader. QED 


A unit vector is a vector with magnitude 1. Notice that for any nonzero vector v, the 


vector Ti is a unit vector which points in the same direction as v, since TT >0 and | Tw | = 
lvi _ 


ivi 1. Dividing a nonzero vector v by ||v|| is often called normalizing v. 

There are specific unit vectors which we will often use, called the basis vectors: 
i=(1,0,0), j = (0,1,0), and k = (0,0, 1) in R; i= (1,0) and j = (0,1) in RÈ. 
These are useful for several reasons: they are mutually perpendicular, since they lie on 
distinct coordinate axes; they are all unit vectors: |i| = |jl = ||kl| = 1; every vector can 
be written as a unique scalar combination of the basis vectors: v = (a,b) = ai+bj in RÊ, 
v 2 (a,b,c) - aà- bj ck in R?. See Figure 1.2.7. 
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z 
v= (a,b,c) 
y y .— 
9 v — (a,b) ck 
ES: 
; bj 0 
J " » 
Oili 2 dq ai ` bj 
(a) R2 (b) v=aitbj (c) R9 (d) v=aitbj+ck 


Figure 1.2.7 Basis vectors in different dimensions 


When a vector v = (a,b,c) is written as v = ai+ bj+ck, we say that v is in component 
form, and that a, b, and c are the i, j, and k components, respectively, of v. We have: 


V=v,i+v,j+03;k,k a scalar = kv = kvi t kv;j kv; k 


V=0,i1+v,j+0,k,w=w,i+w,j+w,k = v+we(v,+w,)i+ (V, + W,)j + (V; +w)k 


V=0,i+0,j+03;k = |v = v2 +02 +0? 


Example 1.4. Let v = (2,1, —1) and w = (3, —4,2) in R?. 


(a) Find v- w. 
Solution: v - w = (2-3,1-(—4), -1- 2) = (-1,5,-3) 


(b) Find 3v + 2w. 
Solution: 3v + 2w = (6,3, —3) + (6, 28,4) = (12, 5,1) 


(c) Write v and w in component form. 
Solution: v = 2i+j—k, w=3i-4j+2k 


(d) Find the vector u such that u + v = w. 
Solution: By Theorem 1.5, u = w- v = -(v - w) = —(-1,5,—3) = (1, -5, 3), by part(a). 


(e) Find the vector u such that u+-v+w=0. 
Solution: By Theorem 1.5, u = —w-v= -(3,-4,2)- (2,1, -1) = (-5,8,- 1). 


(f) Find the vector u such that 2u +i- 2j — k. 
Solution: 2u = -i + 2j +k => u = -4i+j + ik 


(g) Find the unit vector 7% 


lvl 


J a XY =— l _ — = 2 zb. el 
Solution: 4 vec 1) (45, 45, 1] 
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We can now easily prove Theorem 1.1 from the previous section. The distance d between 
two points P = (x,,4,,2,) and Q = (x4, Y2, Z2) in R? is the same as the length of the vector w — v, 
where the vectors v and w are defined as v = (xi, y,,2,) and w = (x2, yo, 25) (see Figure 1.2.8). 
So since w — v = (xo —x1, Y2 — 1,22 —2)), then d = ||w — vll = V(x- 22 + (yo — Y)? + (2; — 2? by 
Theorem 1.2. 


P(x1,y1,21) 


Q(x2, y2,22) 


y 
» 


Figure 1.2.8 Proof of Theorem 1.1: d = || w — vll 


1. Let v= (-1,5,-2) and w = (3,1,1). 
(a) Find v- w. (b) Find v+ w. (c) Find TT: (d) Find | i(v- w)]|. 
(e) Find | 3v-w)|. (D Find-2v+4w. (g) Find v-2w. 
(h) Find the vector u such that u +v +w =i. 
(i) Find the vector u such that u * v +w = 2j+k. 


() Is there a scalar m such that m(v + 2w) = k? If so, find it. 


2. For the vectors v and w from Exercise 1, is | v - w|| = ||v|| ^ || wl? If not, which quantity 
is larger? 

3. For the vectors v and w from Exercise 1, is | v * w|| = | vl| + ilw]? If not, which quantity 
is larger? 

B 

4. Prove Theorem 1.5(f) for R?. 5. Prove Theorem 1.5(g) for R?. 

C 


6. We know that every vector in R? can be written as a scalar combination of the vectors i, 
j, and k. Can every vector in R? be written as a scalar combination of just i and j, i.e. for 
any vector v in R?, are there scalars m, n such that v= mi+ nj? Justify your answer. 
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1.3 Dot Product 


You may have noticed that while we did define multiplication of a vector by a scalar in the 
previous section on vector algebra, we did not define multiplication of a vector by a vector. 
We will now see one type of multiplication of vectors, called the dot product. 


Definition 1.6. Let v = (v,,v2,v3) and w = (w,,w;,w;) be vectors in R. 
The dot product of v and w, denoted by v: w, is given by: 


V*W = UU, HVW + U3Us 


Similarly, for vectors v = (v,,v;) and w = (w,,w,) in R?, the dot product is: 


V*W —UQU, - U3Us 


Notice that the dot product of two vectors is a scalar, not a vector. So the associative law 
that holds for multiplication of numbers and for addition of vectors (see Theorem 1.5(b),(e)), 
does not hold for the dot product of vectors. Why? Because for vectors u, v, w, the dot 
product u-v is a scalar, and so (u- v): w is not defined since the left side of that dot product 
(the part in parentheses) is a scalar and not a vector. 

For vectors v 2 v,i+ v;j* vk and w = w,i+w.j+w;k in component form, the dot product 
is still v- w = vw, U3ws + U3U3. 

Also notice that we defined the dot product in an analytic way, i.e. by referencing vector 
coordinates. There is a geometric way of defining the dot product, which we will now develop 
as a consequence of the analytic definition. 


Definition 1.7. The angle between two nonzero vectors with the same initial point is the 
smallest angle between them. 


We do not define the angle between the zero vector and any other vector. Any two nonzero 
vectors with the same initial point have two angles between them: 0 and 360? — 0. We will 
always choose the smallest nonnegative angle 0 between them, so that 0? < 0 < 180°. See 
Figure 1.3.1. 


u 0 360° -0 
i i — o 
\ / \ Si A 
360° -0 \ Ü \, 360° — 6,’ P H 
(a) 0° <0 < 180° (b) 0 = 180° (c) 0 - 0? 


Figure 1.3.1 Angle between vectors 


We can now take a more geometric view of the dot product by establishing a relationship 
between the dot product of two vectors and the angle between them. 
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Theorem 1.6. Let v, w be nonzero vectors, and let 0 be the angle between them. Then 


cos@ = BE (1.8) 
lv ll ll wll 


Proof: We will prove the theorem for vectors in R? (the proof for RÈ is similar). Let v = 
(v,,U5, v3) and w = (w,,ws,w;). By the Law of Cosines (see Figure 1.3.2), we have 


Iv— wl? = lvii? +l wil? - 21vIl || wll cos@ (1.9) 


(note that equation (1.9) holds even for the “degenerate” cases 0 = 0° and 180°). 


ve 


Figure 1.3.2 


Since v — w= (v — W1, U2 — W2, U3 — W3), expanding ||v ^ w I? in equation (1.9) gives 


2 2 2 2 2 
Ivi + wl —2 I vll | wll cos@ = (o, wi) + (s — ws) + (Gs — Ws) 
= (v? —2u,w, + wÊ) + (v2 - 2v,w, + w2) + (v2 - 2v,w, + w2) 
FO od EN eee 
— (vi + uz +05) + (wy + wy +w;)— 2(01w, + UsUs + VW) 
2 2 
= | vi + ll wll" —2(v*w), so 
—-2| vll | wll cos@ = —2(v*w) , so since v Z0 and w # 0 then 
vw 


cos 9 = ———— , since ||v||>0 and | w||» 0. QED 
Iv ll will 


Example 1.5. Find the angle 0 between the vectors v = (2,1, - 1) and w= (3,—4, 1). 
Solution: Since v: w = (2)(3) + (1)(—4) + (C1)(1) = 1, || v|| = V6, and |w || = V26, then 
Vw 1 1 


~ Ivilwil Veva6 2/39 


Two nonzero vectors are perpendicular if the angle between them is 90°. Since cos90° = 
0, we have the following important corollary to Theorem 1.6: 


& 0.08 = 0=85.41° 


We will write v L w to indicate that v and w are perpendicular. 
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Since cos0 > 0 for 0? < 0 < 90? and cos@ < 0 for 90° < 0 x 180°, we also have: 


By Corollary 1.8, the dot product can be thought of as a way of telling if the angle be- 
tween two vectors is acute, obtuse, or a right angle, depending on whether the dot product 
is positive, negative, or zero, respectively. See Figure 1.3.3. 


WwW w w 


90° < 0 < 180 0 = 90° 
0° < 0 < 90° ` 
v v v 
(a) v-w»0 (b) v:w«0 (c) v:w-0 


Figure 1.3.3 Sign of the dot product & angle between vectors 


Example 1.6. Are the vectors v = (-1,5, —2) and w = (3,1,1) perpendicular? 
Solution: Yes, v Lw since v: w = (—1)(8) + (5)(1) + (-2Y(1) = 0. 


The following theorem summarizes the basic properties of the dot product. 
Theorem 1.9. For any vectors u, v, w, and scalar k, we have 
(a)v-w-w':v Commutative Law 
(b) (&v)-w 2 v- (Ew) - k(v- w) Associative Law 
(c) v-0=0=0-v 


(d) u-(v+w)=u-v+u-w Distributive Law 


(e) (u- v):w-u:w-tv:*w Distributive Law 


(f) |v: wl < I vll iiw |l Cauchy-Schwarz Inequality® 


Proof: The proofs of parts (a)-(e) are straightforward applications of the definition of the 
dot product, and are left to the reader as exercises. We will prove part (f). 

(f) If either v = 0 or w= 0, then v- w= 0 by part (c), and so the inequality holds trivially. So 
assume that v and w are nonzero vectors. Then by Theorem 1.6, 


v: w = cos | vl || wll] , so 
|v- w] = [cos0| | vll || wll , so 


Iv-wi|x vill wl] since|cos0| i. QED 


5 Also known as the Cauchy-Schwarz-Buniakovski Inequality. 
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Using Theorem 1.9, we see that if u-v = 0 and u-w = 0, then u-(kv+/w) = k(u-v)+l(u-w) = 
k(0)+1(0)=0 for all scalars k,l. Thus, we have the following fact: 


Ifu Lv andu Lw, then u | (kv +/w) for all scalars k,/. 


For vectors v and w, the collection of all scalar combinations kv + Iw is called the span 
of v and w. If nonzero vectors v and w are parallel, then their span is a line; if they are 
not parallel, then their span is a plane. So what we showed above is that a vector which is 
perpendicular to two other vectors is also perpendicular to their span. 

The dot product can be used to derive properties of the magnitudes of vectors, the most 
important of which is the Triangle Inequality, as given in the following theorem: 


Theorem 1.10. For any vectors v, w, we have 
(a) lv? =v-v 


(b) || v wl < Ilvll + || wl Triangle Inequality 


(e) Iiv -wli = Ilvil — wil 


Proof: (a) Left as an exercise for the reader. 


(b) By part (a) and Theorem 1.9, we have 


lv 4 wl? 2 (v4 w)-(v-w)-2v:v-v:W-W:V-W-W 
-|v |2 +2(v-w)+ Iwll? , So since a < |a| for any real number a, we have 
< lvl? 4 21v «wl ^ IwIl? , so by Theorem 1.9(f) we have 
s Ivi? +2lv] iwl + lw]? — (vll Iw)? and so 


| v4 wl < livi + || wl after taking square roots of both sides, which proves (b). 


(c) Since v = w * (v- w), then | v|| = | w--(v-w)l < || w||+||v—w]| by the Triangle Inequality, 
so subtracting || w|| from both sides gives ||v|| ^ || w|| < lv — wl. QED 
The Triangle Inequality gets its name from the fact that in any triangle, viw 
no one side is longer than the sum of the lengths of the other two sides (see 
Figure 1.3.4). Another way of saying this is with the familiar statement “the ` w 
shortest distance between two points is a straight line.” : 
Figure 1.3.4 


A 


1. Let v= (5,1, -2) and w = (4,—4,3). Calculate v- w. 
2. Let v= -3i-2j- k and w 2 6i 4j - 2k. Calculate v* w. 


For Exercises 3-8, find the angle 0 between the vectors v and w. 
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3. v 2 (5,1, -2), w = (4, 4,3) 4. v-(7,2,-10), w= (2,6,4) 
5. v=(2,1,4), w - (1, -2,0) 6. v-(42,-1), w = (8,4, -2) 
7. v=—-it+2j+k, w=-31+6j+3k 8. v=i, w= 31+ 2j+4k 


9. Let v 2 (8,4,3) and w = (-2,1,4). Is v L w? Justify your answer. 

10. Let v = (6,0,4) and w = (0,2, — 1). Is v L w? Justify your answer. 

11. For v, w from Exercise 5, verify the Cauchy-Schwarz Inequality |v -w| < ||v || || wll. 
12. For v, w from Exercise 6, verify the Cauchy-Schwarz Inequality |v -w| < ||v || || wll. 
13. For v, w from Exercise 5, verify the Triangle Inequality ||v + w || < ||v|| + l| wll. 


14. For v, w from Exercise 6, verify the Triangle Inequality || v + w || < || v|| + l| wll. 


Note: Consider only vectors in R? for Exercises 15-25. 


15. Prove Theorem 1.9(a). 16. Prove Theorem 1.9(b). 
17. Prove Theorem 1.9(c). 18. Prove Theorem 1.9(d). 
19. Prove Theorem 1.9(e). 20. Prove Theorem 1.10(a). 


21. Prove or give a counterexample: If u-v =u: w, then v = w. 


22. Prove or give a counterexample: If v-w=0 for all v, then w= 0. 
23. Prove or give a counterexample: If u- v= u: w for all u, then v= w. 


24. Prove that |I vil — Iw | € | v — w|| for all v, w. 


25. For nonzero vectors v and w, the projection of v onto w (some- d 
| 
times written as projwv) is the vector u along the same line L | 
as w whose terminal point is obtained by dropping a perpendic- L 
ular line from the terminal point of v to L (see Figure 1.3.5). ad w 
Show that ; 
|. Iv*wl| Figure 1.3.5 


| ul = 


wil” 
(Hint: Consider the angle between v and w.) 


26. Let a, D, and y be the angles between a nonzero vector v in R and the vectors i, j, and 
k, respectively. Show that cos? a + cos? 6 + cos? y = 1. 
(Note: a, D, y are often called the direction angles of v, and cosa, cos f, cosy are called 
the direction cosines.) 
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1.4 Cross Product 


In Section 1.3 we defined the dot product, which gave a way of multiplying two vectors. The 
resulting product, however, was a scalar, not a vector. In this section we will define a product 
of two vectors that does result in another vector. This product, called the cross product, is 
only defined for vectors in R?. The definition may appear strange and lacking motivation, 
but we will see the geometric basis for it shortly. 


Definition 1.8. Let v = (v,,v;,v,) and w = (w,,ws,w;) be vectors in R?. The cross product 
of v and w, denoted by v x w, is the vector in R? given by: 


V X W = (UW; — U3U5,U3U — U1U3, UU — U3W) (1.10) 


Example 1.7. Find i xj. 
Solution: Since i= (1,0,0) and j = (0,1,0), then 
i x j = ((0)(0) — (0)(1), (0)(0) — (1)(0), CL)(1) — (0)(0)) 


= (0,0, 1) 
=k 


Figure 1.4.1 


Similarly it can be shown that j x k =i and kxi=j. 


In the above example, the cross product of the given vectors was perpendicular to both 
those vectors. It turns out that this will always be the case. 


Theorem 1.11. If the cross product v x w of two nonzero vectors v and w is also a nonzero 
vector, then it is perpendicular to both v and w. 
Proof: We will show that (v x w):v = 0: 


(v x W)* V = (Ust05 — V3 W2, U3W1 — V1W3, V1W3 — U2W1)* (V1, Us, Us) 
= VWV — U3U)3U, + U3W Ug — U1U)3Us + U1U)3U3 — U2W1U3 
= U1UsU3 = U,U2W3 + W,U2U3 = W ,U2U3 + U{;W2V3 = U,;W2V3 


= 0, after rearranging the terms. 


S.V X w Lv by Corollary 1.7. 
The proof that v x w L w is similar. QED 


As a consequence of the above theorem and Theorem 1.9, we have the following: 
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The span of any two nonzero, nonparallel vectors v, w in R? is a plane P, so the above 
corollary shows that v x w is perpendicular to that plane. As shown in Figure 1.4.2, there 
are two possible directions for v x w, one the opposite of the other. It turns out (see Appendix 
B) that the direction of v x w is given by the right-hand rule, that is, the vectors v, w, v x w 
form a right-handed system. Recall from Section 1.1 that this means that you can point your 
thumb upwards in the direction of v x w while rotating v towards w with the remaining four 
fingers. 


VXW 


Ya 


x -VXW 


Figure 1.4.2 Direction of v x w 


We will now derive a formula for the magnitude of v x w, for nonzero vectors v, w: 


2 2 2 2 
lv x wl|^ = (Uzws — VgW2)" + (VW — VWs)” + (VW — U3W) 


2,2 2, ,2,,2 2, ,2,,2 


= 2 2 2,2 
= UZ W3 — 2VgW2U3W3 + U3 Wy UZ WI — 2U,USUsUs UIW + UU, — 2UuW4UgWs t UU 


1 


E v2(w? T w?) + v2(w? + w?) + v2(u? + w2) — 2(V WUW + V1W1U3W3 + U3U3U3U3) 


and now adding and subtracting v2w?, v2w2, and v2w? on the right side gives 


Prk Det ae One 
7 tw;)+u; (wy +w 


— (v2u? + v2w? + v2w? + 2(U,W,V,W, + U,U,U3U3 + U$UsUsU3)) 


= (v? + v2 T v2yw? + w2 + w?) 


2 2 


=v? (w? +w ; +w) 4 v2(w? + w? +w?) 


E (vw)? RS (vaw)? F (vw)? + 2(v,W,)(VgW2) + (V W) V3 W3) + Z(V2W)(V3W3)) 


so using (a +b - c =a? +b? +c? +2ab +2ac + 2bc for the subtracted term gives 


P RUIT IT PET 2 
— (uf +u -F u$ (wj + wy * w$) — (VW + U3Us + V3W3) 
= Ivi? wl? - (vw? 


ow? 
= | v? il — e , since ||v|| > 0 and || w|| > 0, so by Theorem 1.6 
I vli? wi? 
= IvIl? lw? (1 — cos? 0) , where 0 is the angle between v and w, so 


lv x wl? = |v? || w ? sin?0 , and since 0? x 0 x 180°, then sin@ = 0, so we have: 
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If 0 is the angle between nonzero vectors v and w in R?, then 


lv x wll = Ivi wl sin8 


It may seem strange to bother with the above formula, when the magnitude of the cross 
product can be calculated directly, like for any other vector. The formula is more useful for 
its applications in geometry, as in the following example. 


Example 1.8. Let APQR and PQRS bea triangle and parallelogram, respectively, as shown 
in Figure 1.4.3. 


Figure 1.4.3 


Think of the triangle as existing in R?, and identify the sides QR and QP with vectors v 
and w, respectively, in R?. Let 0 be the angle between v and w. The area A par of APQR is 
ibh, where b is the base of the triangle and A is the height. So we see that 


b-|v| and A= |w] sin 


1 . 
Apar = ; VIIw] sind 


=-|llvxw 


So since the area A pors of the parallelogram PQRS is twice the area of the triangle APQR, 
then 
Apqns = lvl |w] sin@ 


By the discussion in Example 1.8, we have proved the following theorem: 


Theorem 1.13. Area of triangles and parallelograms 


(a) The area A of a triangle with adjacent sides v, w (as vectors in R?) is: 


1 
A - -|vx wl 
2 


(b) The area A of a parallelogram with adjacent sides v, w (as vectors in R) is: 


A - [v x wll 
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It may seem at first glance that since the formulas derived in Example 1.8 were for the 
adjacent sides QP and QR only, then the more general statements in Theorem 1.13 that the 
formulas hold for any adjacent sides are not justified. We would get a different formula for 
the area if we had picked PQ and PR as the adjacent sides, but it can be shown (see Exercise 
26) that the different formulas would yield the same value, so the choice of adjacent sides 
indeed does not matter, and Theorem 1.13 is valid. 

Theorem 1.13 makes it simpler to calculate the area of a triangle in 3-dimensional space 
than by using traditional geometric methods. 


Example 1.9. Calculate the area of the triangle APQR, where P = (2,4, —7), Q = (3,7,18), 
and R = (-5, 12,8). 


Solution: Let v = PQ and w = PR, as in Figure 1.4.4. Then 
v = (8,7,18)-(2,4, —7) = (1,3, 25) and w = (-5,12,8)-(2,4,-7) = 
(—7,8,15), so the area A of the triangle APQR is 


E 
Q(3,7,18) 


R(-5, 12,8) 


1 1 
A= 3 Iv x wl] = 3 I| (1, 3, 25) x (—7, 8, 15) 


1 
5 || ((8)(15) - (25X8), (25)(—7) - (1)(15), (1)(8) - (8)(—7)) | 


P(2,4,-7) 
= 5-155, -190,29)| Figure 144 
= $ V C188: C1907 +297 = 2 60966 
A = 123.46 


Example 1.10. Calculate the area of the parallelogram PQRS, where P = (1,1), Q = (2,3), 
R = (5,4), and S = (4,2). 


Solution: Let v = SP and w = SR, as in Figure 1.4.5. Then 4” 
v-(L1)-(4,2) = (-3,-1) and w = (5,4-(4,2) = (1,2) But 4 
these are vectors in R?, and the cross product is only defined 
for vectors in R?. However, R? can be thought of as the subset 
of R? such that the z-coordinate is always 0. So we can write 2 
v 2(-8,-1,0) and w = (1,2,0). Then the area A of PQRS is 


Az |vx wl = [C 3,-1,0) x 1,2,0)]| 
= [(-1X0) - (02, (00) - 3X0), 73) - C DAD || 
= ||(0,0,-5)| 

A=5 


1 2 3 4 5 
Figure 1.4.5 
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The following theorem summarizes the basic properties of the cross product. 


Theorem 1.14. For any vectors u, v, w in R?, and scalar k, we have 
(a)vxw=-wxv Anticommutative Law 


(b)ux(v+w)=uxv+uxw Distributive Law 


(c)(u+v)Xw=uxWt+vxw Distributive Law 


(d) (kv) x w= v x (kw) = k(v x w) Associative Law 
(e) vx0=0=0xv 
(vxv-20 


(g) vx w 2 0 if and only if v || w 


Proof: The proofs of properties (b)-(f) are straightforward. We will prove parts (a) and (g) 
and leave the rest to the reader as exercises. 


(a) By the definition of the cross product and scalar multipli- 
cation, we have: 


V X W = (U5U5 — V3W2, V3W 1 — U1U3, U1Us — V2W1) 
= —(U3W2 — V2W3, U1Us — U3U1, U3U, — U1U5) 


= —(WsUs — UU, W301 — W1U3, UUs — UsU1) 


——WwWXv 


x wxv 


Note that this says that v x w and w x v have the same mag- Figure 1.4.6 


nitude but opposite direction (see Figure 1.4.6). 


(g) If either v or w is 0 then v x w = 0 by part (e), and either v = 0 = 0w or w = 0 = 0v, so v 
and w are scalar multiples, i.e. they are parallel. 

If both v and w are nonzero, and 0 is the angle between them, then by formula (1.11), 
vx w= 0 if and only if || vl| || w|| sin@ = 0, which is true if and only if sin@ = 0 (since || v|| > 0 
and ||w|| > 0). So since 0° < 0 < 180°, then sin@ = 0 if and only if 0 = 0° or 180°. But the 
angle between v and w is 0° or 180° if and only if v || w. QED 


Example 1.11. Adding to Example 1.7, we have 
ixj=k jxk=i kxi-j 
j*i--k kxj--i ixk--j 
ixi-jxj-kxk-0 


Recall from geometry that a parallelepiped is a 3-dimensional solid with 6 faces, all of 
which are parallelograms.® 


6An equivalent definition of a parallelepiped is: the collection of all scalar combinations k4v1 * kovo + ava of 
some vectors v1, V9, V3 in R3, where 0 < ki,ko,ha <1. 
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Example 1.12. Volume of a parallelepiped: Let the vectors u, v, w in R? represent adjacent 
sides of a parallelepiped P, with u, v, w forming a right-handed system, as in Figure 1.4.7. 
Show that the volume of P is the scalar triple product u:(v x w). 


Solution: Recall that the volume vol(P) of a par- V*W 


allelepiped P is the area A of the base parallel- 
ogram times the height h. By Theorem 1.13(b), 
the area A of the base parallelogram is ||v x w|]. 
And we can see that since v x w is perpendicular 
to the base parallelogram determined by v and 
w, then the height h is || u|| cos0, where 0 is the 
angle between u and v x w. By Theorem 1.6 we 
know that 


u-(vx w) . 
cos@ = ————— ——. Hence, Figure 1.4.7 Parallelepiped P 
llull lv xw l| 
vol(P)=Ah 
llullu: (v x w) 
-|vxwil 
Iuli lv x will 

=u:(v x w) 


In Example 1.12 the height A of the parallelepiped is ||u|| cos0, and not -||ul| cos, be- 
cause the vector u is on the same side of the base parallelogram's plane as the vector v x w 
(so that cos@ > 0). Since the volume is the same no matter which base and height we use, 
then repeating the same steps using the base determined by u and v (since w is on the same 
side of that base's plane as u x v), the volume is w:(ux v). Repeating this with the base 
determined by w and u, we have the following result: 


For any vectors u, v, w in R, 


u:(vxw)-w-:(uxv)-v:(wxu) 
(Note that the equalities hold trivially if any of the vectors are 0.) 
Since vx w = —w x v for any vectors v, w in R?, then picking the wrong order for the three 
adjacent sides in the scalar triple product in formula (1.12) will give you the negative of the 


volume of the parallelepiped. So taking the absolute value of the scalar triple product for 
any order of the three adjacent sides will always give the volume: 


Theorem 1.15. If vectors u, v, w in R? represent any three adjacent sides of a paral- 


lelepiped, then the volume of the parallelepiped is |u: (v x w)|. 


Another type of triple product is the vector triple product u x (v x w). The proof of the 
following theorem is left as an exercise for the reader: 
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Theorem 1.16. For any vectors u, v, w in R?, 


ux(vxw)-(u:w)v -(u: v)w 


An examination of the formula in Theorem 1.16 gives some idea of the geometry of the 
vector triple product. By the right side of formula (1.13), we see that u x (v x w) is a scalar 
combination of v and w, and hence lies in the plane containing v and w (i.e. ux (v x w), v 
and w are coplanar). This makes sense since, by Theorem 1.11, ux (vx w) is perpendicular 
to both u and v x w. In particular, being perpendicular to v x w means that u x (v x w) lies 
in the plane containing v and w, since that plane is itself perpendicular to v x w. But then 
how is u x (v x w) also perpendicular to u, which could be any vector? The following example 
may help to see how this works. 


Example 1.13. Find u x (vx w) for u = (1,2,4), v = (2,2,0), w = (1,3,0). 


Solution: Since u: v = 6 and u: w = 7, then 


ux(vxw)-(u-w)v - (u- vw 
= 7(2,2,0)—6(1,3,0) = (14,14,0) - (6, 18, 0) 
= (8, —4, 0) 


Note that v and w lie in the xy-plane, and that u x (v x w) also lies in that plane. Also, 
u X (v x w) is perpendicular to both u and v x w = (0,0, 4) (see Figure 1.4.8). 


EX 


Figure 1.4.8 


For vectors v = v,i+v,j+v;k and w = w,i+w,j+w;k in component form, the cross product 
is written as: vx W = (U,.W,—U3W,)i+(U;W,—U,W;)j+(U,W,—v,W,)k. It is often easier to use the 
component form for the cross product, because it can be represented as a determinant. We 
will not go too deeply into the theory of determinants’; we will just cover what is essential 
for our purposes. 


"See ANTON and RORRES for a fuller development. 
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A 2x 2 matrix is an array of two rows and two columns of scalars, written as 
elo b 
c d 


where a,b,c,d are scalars. The determinant of such a matrix, written as 


a b 
c d 


a b a b 
: 2 or det is ij : 
is the scalar defined by the following formula: 
" A —-ad-bc 


It may help to remember this formula as being the product of the scalars on the downward 
diagonal minus the product of the scalars on the upward diagonal. 


Example 1.14. 
f 2 


3 " = (1)(4) - (2X3) = 4-6 = -2 


A 8x3 matrix is an array of three rows and three columns of scalars, written as 
a, Q5 Q3 ay As a3 
b, b, bs} or |b, b, bg], 
Cy Co C3 Cy Co C3 
and its determinant is given by the formula: 


Qi A, Gs 
b, b, b, 


Cy, C2 C3 


b, bs 


C2 Cg 


b, b, 


Ci C3 


b, b, 


Ci Cə 


=a, — Qs + ds (1.14) 


One way to remember the above formula is the following: multiply each scalar in the first 
row by the determinant of the 2 x 2 matrix that remains after removing the row and column 
that contain that scalar, then sum those products up, putting alternating plus and minus 
signs in front of each (starting with a plus). 


Example 1.15. 


1 02 
4 -1 3]=1 T9 -0 ELS EN. -1(-2-0)-0(8—3)4-2(0—-1) 20 
"CN: 0 2 1 2 1 0 
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We defined the determinant as a scalar, derived from algebraic operations on scalar en- 
tries in a matrix. However, if we put three vectors in the first row of a 3x 3 matrix, then 
the definition still makes sense, since we would be performing scalar multiplication on those 
three vectors (they would be multiplied by the 2x2 scalar determinants as before). This gives 
us a determinant that is now a vector, and lets us write the cross product of v = v,i+v,j+v,k 
and w- w,itw;j-w;jk as a determinant: 

i j k 
U; Ug Us 
W, W2 Us 


Vxw= 


= (U,W3 — Ugw5)i + (VW; — v,w;)j + (VW — Vaw )k 


Example 1.16. Let v= 4i-j+3k and w 2 i4 2k. Then 


i jk] E 
vxw=|4 -1 3ļ=| 1 3hi-]$ 3lj+|4 ^T [k=-2i-5j+k 
E 0 2 12 1 0 


The scalar triple product can also be written as a determinant. In fact, by Example 1.12, 
the following theorem provides an alternate definition of the determinant of a 3 x 3 matrix 
as the volume of a parallelepiped whose adjacent sides are the rows of the matrix and form 
a right-handed system (a left-handed system would give the negative volume). 


Theorem 1.17. For any vectors u = (U4, U2, U3), V = (U1, Us, Us), W = (w,,ws,ws) in R: 


Uj; U Us 
u-(vxw)-2|U Us; 
WU; Us 


Example 1.17. Find the volume of the parallelepiped with adjacent sides u = (2,1,3), v= 
(-1,3, 2), w = (1,1,—2) (see Figure 1.4.9). 


Solution: By Theorem 1.15, the volume vol(P) of the parallelepiped 
P is the absolute value of the scalar triple product of the three 
adjacent sides (in any order). By Theorem 1.17, 


21 8 
u-‘(vxw)=|-1 3 2 x 
11 -2 
3 2 -1 2 s 
-2 A 
P E! | i ie ee || Figure14.9 P 


= 2(-8) - 1(0) + 3(-4) = -28, so 
vol(P) = |-28| = 28. 


1.4 Cross Product 


Interchanging the dot and cross products can be useful in proving vector identities: 


u:*w u'z 


Example 1.18. Prove: (ux v)- (w x z)= ls e D for all vectors u, v, w, z in R?. 


Solution: Let x u x v. Then 


(ux v)-(wxz)2x-(w xz) 
-w'(zxx) (by formula (1.12)) 
=w- (z x (u x v)) 
-w'((z:v)u- (z-u)v) (by Theorem 1.16) 
- (z: v) (w-u)- (z:u)w:v) 
- (u*: w)(v:z)- (u:z)(v:w) (by commutativity of the dot product). 


 |u:w u'z 
vw v-z 


Exercises 1-6, calculate v x w. 

1. v-(5,1,-2), w = (4, -4,3) 2. v2 (7,2,-10), w = (2,6,4) 
3. v=(2,1,4), w - (1, -2,0) 4. v=(1,3,2), w 2 (7,2, -10) 
5. v=—-i+2j+k, w=-3i1+6j+3k 6. vci w= 31+ 2j+4k 


For Exercises 7-8, calculate the area of the triangle APQR. 

7. P=(5,1,-2), Q =(4,-4,3), R = (2,4,0) 8. P = (4,0,2), Q = (2,1,5), R = (-1,0,-1) 
For Exercises 9-10, calculate the area of the parallelogram PQRS. 

9. P =(2,1,3), Q -(,4,5, R = (2,5,3), S = (8,2, 1) 

10. P =(-2,-2), Q = (1,4), R = (6,6), S = (3,0) 

For Exercises 11-12, find the volume of the parallelepiped with adjacent sides u, v, w. 
11. u-(1,1,3, v = (2,1,4), w = (5,1,-2) 12. u= (1,3,2), v = (7,2,—10), w = (1,0,1) 
For Exercises 13-14, calculate u- (v x w) and u x (v x w). 

13. u = (1,1,1), v = (3,0,2), w = (2,2,2) 14. u= (1,0,2), v=(-1,0,3), w = (2,0,-2) 


15. Calculate (u x v): (w x z) for u = (1,1,1), v = (3,0,2), w = (2,2,2), z = (2, 1,4). 


29 
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B 


16. If v and w are unit vectors in R?, under what condition(s) would v x w also be a unit 
vector in R? ? Justify your answer. 


17. Show that if v x w = 0 for all w in RÌ, then v = 0. 


18. Prove Theorem 1.14(b). 19. Prove Theorem 1.14(c). 
20. Prove Theorem 1.14(d). 21. Prove Theorem 1.14(e). 
22. Prove Theorem 1.14(f). 23. Prove Theorem 1.16. 


24. Prove Theorem 1.17. (Hint: Expand both sides of the equation.) 


25. Prove the following for all vectors v, w in R?: 
(a) Iv x wl? + Iv wl? = lvl? Iw II? 


(b) If v-w=0 and vx w= 0, then v=0 or w=0. 
C 


26. Prove that in Example 1.8 the formula for the area of the triangle APQR yields the 
same value no matter which two adjacent sides are chosen. To do this, show that i |u x 
(—w)|| = i lv x wl, where u = PR, -w = PQ, and v = QR, w = QP as before. Similarly, 
show that i l(—u) x (—v)|| = 5 lv x w||, where -u=RP and -v = RQ. 


27. Consider the vector equation ax x - b in R?, where a # 0. Show that: 
(a) a-b=0 
bxa ; 
(b) x- lal t ka is a solution to the equation, for any scalar k 
28. Prove the Jacobi identity: ux (vx w)+ v x (w xu)+w x (u x v)=0 
29. Show that u, v, w lie in the same plane in R? if and only if u- (v x w) = 0. 


30. For all vectors u, v, w, z in R?, show that 
(ux v) x (w x z) = (z- (ux v))w - (w : (u x v)z 
and that 
(ux v) x (w x z)  (u-(wxz)v-(v-(wxz)u 


Why do both equations make sense geometrically? 
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1.5 Lines and Planes 


Now that we know how to perform some operations on vectors, we can start to deal with some 
familiar geometric objects, like lines and planes, in the language of vectors. The reason 
for doing this is simple: using vectors makes it easier to study objects in 3-dimensional 
Euclidean space. We will first consider lines. 


Line through a point, parallel to a vector 


Let P = (xo, yo, Zo) be a point in R?, let v = (a,b, c) be a nonzero vector, and let L be the line 
through P which is parallel to v (see Figure 1.5.1). 


Figure 1.5.1 


Let r = (xo, yo, Zo) be the vector pointing from the origin to P. Since multiplying the vector 
v by a scalar t lengthens or shrinks v while preserving its direction if t > 0, and reversing 
its direction if t « 0, then we see from Figure 1.5.1 that every point on the line L can be 
obtained by adding the vector tv to the vector r for some scalar t. That is, as t varies over all 
real numbers, the vector r+ £v will point to every point on L. We can summarize the vector 
representation of L as follows: 


For a point P = (x0, yo, 29) and nonzero vector v in R?, the line L through P parallel to v 
is given by 
r+tv, for -co«t«oo (1.16) 


where r = (x, yo, Zo) is the vector pointing to P. 


Note that we used the correspondence between a vector and its terminal point. Since 
v = (a,b,c), then the terminal point of the vector r+ tv is (x) at, yo + bt, Z)+ ct). We then get 
the parametric representation of L with the parameter t: 


For a point P = (xy, yo,2)) and nonzero vector v = (a,b,c) in R?, the line L through P 
parallel to v consists of all points (x, y, z) given by 


x-2xjtat, y=y+bt, z=z2,+ct, for -oo«t«oo (1.17) 


Note that in both representations we get the point P on L by letting t = 0. 
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In formula (1.17), if a Z 0, then we can solve for the parameter t: t = (x —x,)/a. We can also 
solve for t in terms of y and in terms of z if neither b nor c, respectively, is zero: t = (y — y9)/b 
and t =(z—z,)/c. These three values all equal the same value £, so we can write the following 
system of equalities, called the symmetric representation of L: 


For a point P = (x,, Yo, Zo) and vector v = (a,b,c) in R? with a, b and c all nonzero, the line 
L through P parallel to v consists of all points (x, y, z) given by the equations 


X—=Xo y-—-yo 2% Zo 
MEG eae, 1.18 
a b c ( ) 


What if, say, a = 0 in the above scenario? We can not divide by 
zero, but we do know that x = x, +at, and so x = x+ 0t = x,. Then the 
symmetric representation of L would be: 


>, 
. 


N 


X -— Xo, Am (1.19) 2 


b c —— bd 

Note that this says that the line L lies in the plane x = xy, which is B 
parallel to the yz-plane (see Figure 1.5.2). Similar equations can be ai 
derived for the cases when b = 0 or c=0. Figure 1.5.2 

You may have noticed that the vector representation of L in formula (1.16) is more compact 
than the parametric and symmetric formulas. That is an advantage of using vector notation. 
Technically, though, the vector representation gives us the vectors whose terminal points 
make up the line L, not just L itself. So you have to remember to identify the vectors r+ tv 
with their terminal points. On the other hand, the parametric representation always gives 
just the points on L and nothing else. 


Example 1.19. Write the line L through the point P = (2,3,5) and parallel to the vector 
v - (4,-1,6), in the following forms: (a) vector, (b) parametric, (c) symmetric. Lastly: (d) find 
two points on L distinct from P. 


Solution: (a) Let r= (2,3,5). Then by formula (1.16), L is given by: 
r+itv=(2,3,5)+¢(4,-1,6), for -co«t «oo 
(b) L consists of the points (x, y, z) such that 
x=24+4t, y=38-t, z=5+6t, for -co«t«oo 


(c) L consists of the points (x, y, z) such that 


x-2 y-3 z-5 


4 -1 6 
(d) Letting t = 1 and £ = 2 in part(b) yields the points (6,2, 11) and (10,1,17) on L. 
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Line through two points 


Let P, = (xi, 91,21) and P, = (x5, Y2, Z2) be distinct points 
in R?, and let L be the line through P, and P,. Let r, = 
(x1; y1, 24) and r; = (x5, y5, 25) be the vectors pointing to P, 
and P,, respectively. Then as we can see from Figure 
1.5.8, r,— r; is the vector from P, to P,. So if we multiply 
the vector r, —r, by a scalar ¢ and add it to the vector 
r;, we will get the entire line L as £ varies over all real 
numbers. The following is a summary of the vector, para- 
metric, and symmetric forms for the line L: Figure 1.5.8 


J 
> 


Let P, = (x1,41,21), P2 = (xs, 5,25) be distinct points in R?, and let r, = (Ay me ET 
(x5, ya, Z3). Then the line L through P, and P, has the following representations: 


Vector: 
r,+t(r,-r,), for -co«t«oo (1.20) 


Parametric: 
x-xyt(x—xjt, y-yit(y-y)t, z-z T(2;—2)t, for -oo«t«oo (1.21) 


Symmetric: 


x-xu y-n 2-2 
X3—X1 Yo7M 2.721 


Gf x, Z X2, Yı É Y2, and zZ, É Zə) (1.22) 


Example 1.20. Write the line L through the points P, = (-3,1,—4) and P, = (4,4,—6) in 
parametric form. 


Solution: By formula (1.21), L consists of the points (x, y, z) such that 
x=-34+7t, y=1+3t, z=-4-2t, for -co«t«oo 


Distance between a point and a line 


Let L be a line in R? in vector form as r+ tv (for —oo < t < oo), PP 
and let P be a point not on L. The distance d from P to L is the w/ d 
length of the line segment from P to L which is perpendicular to L Jo) | L 
(see Figure 1.5.4). Pick a point Q on L, and let w be the vector from Q 
Q to P. If 0 is the angle between w and v, then d = || w|| sin@. So Figure 1.5.4 
since [| v x w]|| = || vl || wll sin@ and v 4 0, then: 
„leew (1.23) 


lvl 
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Example 1.21. Find the distance d from the point P = (1,1,1) to the line L in Example 1.20. 
Solution: From Example 1.20, we see that we can represent L in vector form as: r + tv, for 
r-(-3,1,-4) and v = (7,8,-2). Since the point Q = (-3,1,—4) is on L, then for w = QP = 
(1,1,1) - (-3,1, —4) = (4,0,5), we have: 


ij k 7 E 
vxwelm alaa me cese a 8 aee 
AL eue 0 5 4 5 4 0 


P lvxw]| ]|15i-43j-12k|  V/15?-(-43)?-(-12)?  v2218 er 


Ivi |(7,3,-2) JP +32 c (-2* v62 


It is clear that two lines L, and L,, represented in vector form as r, + sv, and r, + tvs, 
respectively, are parallel (denoted as L, || L») if v, and v, are parallel. Also, L, and L, are 
perpendicular (denoted as L, L L») if v; and v, are perpendicular. 


In 2-dimensional space, two lines are either identical, parallel, or they | id 
intersect. In 3-dimensional space, there is an additional possibility: two B ZI 
lines can be skew, that is, they do not intersect but they are not parallel. y | | 


However, even though they are not parallel, skew lines are on parallel  ' 
planes (see Figure 1.5.5). E 0 


To determine whether two lines in R? intersect, it is often easier to use 
the parametric representation of the lines. In this case, you should use dif- 
ferent parameter variables (usually s and t) for the lines, since the values of the parameters 
may not be the same at the point of intersection. Setting the two (x,y,z) triples equal will 
result in a system of 3 equations in 2 unknowns (s and f). 


Figure 1.5.5 


Example 1.22. Find the point of intersection (if any) of the following lines: 


+1 -2 -1 -8 +3 
= Ee ce and ee aa == 


3 2 -1 -3 2 


Solution: First we write the lines in parametric form, with parameters s and t: 
x=-14+38s, y=2+2s, z=1-s and x=-3+t, y=8-3t, z=-34+2t 


The lines intersect when (—1+3s,2+2s,1—s)=(-—3+1t,8 —3¢,-3+2t) for some s, t: 


-14+3s=-3+t: >t=2+3s 
24+28=8-3t: > 24+2s =8-3(2+3s8s)=2-9s > 2s =-9s > s =0>t=24+3(0) =2 
1-s=-3+2t: 1-0=-3+2(2)>1=1 v (Note that we had to check this.) 


Letting s = 0 in the equations for the first line, or letting ¢ = 2 in the equations for the second 
line, gives the point of intersection (— 1,2, 1). 
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We will now consider planes in 3-dimensional Euclidean space. 
Plane through a point, perpendicular to a vector 


Let P be a plane in R?, and suppose it contains a point P, = (xy, yo, Zo). Let n = (a,b,c) be 
a nonzero vector which is perpendicular to the plane P. Such a vector is called a normal 
vector (or just a normal) to the plane. Now let (x,y,z) be any point in the plane P. Then 
the vector r = (x — xo, y — Yo, Z — Zo) lies in the plane P (see Figure 1.5.6). So if r 40, thenr tn 
and hence n:r = 0. And if r= 0 then we still have n.r = 0. 


(x,y,z) (Xo, yo, Zo) 


Figure 1.5.6 The plane P 


Conversely, if (x,y,z) is any point in R? such that r = (x — x, y — Yo Z — Zo) 0 and n-r = 0, 
then r | n and so (x,y,z) lies in P. This proves the following theorem: 


Theorem 1.18. Let P be a plane in R3, let (xo, yo, Zo) be a point in P, and let n = (a,b,c) bea 
nonzero vector which is perpendicular to P. Then P consists of the points (x, y, z) satisfying 
the vector equation: 


n:r-0 (1.24) 


where r = (x — xy, y — yo, Z — Zo), or equivalently: 


a(x x) + b(y-y))*c(z-2,)-0 


The above equation is called the point-normal form of the plane P. 


Example 1.23. Find the equation of the plane P containing the point (—3,1,3) and perpen- 
dicular to the vector n = (2,4,8). 


Solution: By formula (1.25), the plane P consists of all points (x, y, z) such that: 
2(x-3)-4(y-1)-8(2-3) 20 


If we multiply out the terms in formula (1.25) and combine the constant terms, we get an 
equation of the plane in normal form: 


ax+by+cz+d=0 (1.26) 


For example, the normal form of the plane in Example 1.23 is 2x + 4y + 8z — 22 = 0. 
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Plane containing three noncollinear points 


In 2-dimensional and 3-dimensional space, two points determine a line. Two points do 
not determine a plane in R?. In fact, three collinear points (i.e. all on the same line) do not 
determine a plane; an infinite number of planes would contain the line on which those three 
points lie. However, three noncollinear points do determine a plane. For if Q, R and S are 
noncollinear points in R?, then QR and QS ar are nonzero vectors which are not ; parallel (by (by 
noncollinearity), and so their cross product QR x Qs is perpendicular to both QR and Qs : 
So QR and Qs (and hence Q, R and S) lie in the plane through the point Q with normal 
vector n = QR x QS (see Figure 1.5.7). 


n-QRxQS$ 


Figure 1.5.7 Noncollinear points Q, R, S 


Example 1.24. Find the equation of the plane P containing the points (2, 1,3), (1, 21,2) and 
(3,2, 1). 


Solution: Let Q = (2,1,3), R = (1,—1,2) and S = (8,2,1). Then for the vectors QR -(-1,-2,-1) 
and QS - (1,1, —2), the plane P has a normal vector 


n=QR x QS -(-1,-2,-1) x (1,1,-2) = (5,-3,1) 


So using formula (1.25) with the point Q (we could also use R or S), the plane P consists of 
all points (x, y, z) such that: 


5(x-2)-3(y-1)* (2-3) 20 


or in normal form, 
5x-8y+z-10=0 


We mentioned earlier that skew lines in R? lie on separate, parallel planes. So two skew 
lines do not determine a plane. But two (nonidentical) lines which either intersect or are 
parallel do determine a plane. In both cases, to find the equation of the plane that contains 
those two lines, simply pick from the two lines a total of three noncollinear points (i.e. one 
point from one line and two points from the other), then use the technique above, as in 
Example 1.24, to write the equation. We will leave examples of this as exercises for the 
reader. 
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Distance between a point and a plane 


The distance between a point in R? and a plane is the length of the line segment from 
that point to the plane which is perpendicular to the plane. The following theorem gives a 
formula for that distance. 


Theorem 1.19. Let Q = (xv, y,,2,) be a point in R, and let P be a plane with normal form 
ax+by+cz+d=0 that does not contain Q. Then the distance D from Q to P is: 


laxo - bys - ez 4 d | 
va? 4 b? 4 c? 


Proof: Let R = (x,y,z) be any point in the plane P (so that ax+ by * cz - d = 0) and let 
r= RQ = (xy — x, Yo —Y,2) — Z). Then r Z 0 since Q does not lie in P. From the normal form 
equation for P, we know that n = (a,b,c) is a normal vector for P. Now, any plane divides 
R? into two disjoint parts. Assume that n points toward the side of P where the point Q 
is located. Place n so that its initial point is at R, and let 0 be the angle between r and 
n. Then 0? « 0 < 90°, so cos0 > 0. Thus, the distance D is cos0 ||r|| = |cos0| ||r|| (see Figure 
1.5.8). 


D (1.277) 


P 
Figure 1.5.8 
l l n-r 
By Theorem 1.6 in Section 1.3, we know that cos0 = Tall’ so 


n'r n'r| ja(xo;—x)* bly — y) + celz- 2)l 
Dsitosellxpe DUI ap ECL. Be Out (tl 
In ll |l Inl va? 4 b? 4 c? 
| laxo + by; *ezo-(axt by cz) lax; by, *ezo;-(-d)| lax; bys* ezo* d| 
Va? +b? 4 c? Va? +b? 4 c? Va? +b? 4 c? 


If n points away from the side of P where the point Q is located, then 90? « 0 « 180? and 
so cos <0. The distance D is then |cos@|||r||, and thus repeating the same argument as 
above still gives the same result. QED 


Example 1.25. Find the distance D from (2,4, —5) to the plane from Example 1.24. 
Solution: Recall that the plane is given by 5x -3y +z — 10 2 0. So 


2)-3(4)-1(-5)-10] |-1 i 
poe ee LE LT. ong 


V/582:(-3341 V85 v35 
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Line of intersection of two planes 


Note that two planes are parallel if they have normal vectors that 
are parallel, and the planes are perpendicular if their normal vectors 
are perpendicular. If two planes do intersect, they do so in a line (see 
Figure 1.5.9). Suppose that two planes P, and P, with normal vectors 
n, and n,, respectively, intersect in a line L. Since n; xn, L n,, then 
n, X n, is parallel to the plane P,. Likewise, n, x n, L n, means that 
n, Xn; is also parallel to P,. Thus, n, x n, is parallel to the intersection 
of P, and P,, i.e. n, x n, is parallel to L. Thus, we can write L in the following vector form: 


Figure 1.5.9 


L:r+t(n; x nj), for -co«t«oo (1.28) 


where r is any vector pointing to a point belonging to both planes. To find a point in both 
planes, find a common solution (x, y, z) to the two normal form equations of the planes. This 
can often be made easier by setting one of the coordinate variables to zero, which leaves you 
to solve two equations in just two unknowns. 


Example 1.26. Find the line of intersection L of the planes 5x 3y + z - 10 = 0 and 2x + 4y — 
z+3=0. 


Solution: The plane 5x- 3y +z -— 10 = 0 has normal vector n, = (5,—3,1) and the plane 2x + 
4y—z+3=0 has normal vector n, = (2,4, — 1). Since n, and n, are not scalar multiples, then 
the two planes are not parallel and hence will intersect. A point (x,y,z) on both planes will 
satisfy the following system of two equations in three unknowns: 


5x-8y+z-10=0 
2x+4y-—z+ 3=0 


Set x = 0 (why is that a good choice?). Then the above equations are reduced to: 


-38y+z-10=0 
4y—z+ 3=0 


The second equation gives z = 4y +3, substituting that into the first equation gives y = 7. 
Then z = 31, and so the point (0,7,31) is on L. Since n, x n, = (- 1, 7,26), then L is given by: 


r+ t(n; x n,) = (0,7,31)+ £(-1,7,26), for -co«t«oo 
or in parametric form: 


x=-t, y=7+T7t, z2=31+26t, for -co«t«oo 
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A 

For Exercises 1-4, write the line L through the point P and parallel to the vector v in the 
following forms: (a) vector, (b) parametric, and (c) symmetric. 

1. P=(2,3,-2), v= (5,4, -3) 2. P=(8,-1,2), v = (2,8,1) 

3. P =(2,1,3), v= (1,0,1) 4. P = (0,0,0), v = (7,2,—10) 


For Exercises 5-6, write the line L through the points P, and P, in parametric form. 


5. P, =(1,-2,-3), P. = (8,5,5) 6. P, =(4,1,5), P = (—2, 1,3) 


For Exercises 7-8, find the distance d from the point P to the line L. 

7. Pz(L-L-1) L:x--2-2t, y=4t,z=7+t 

8. P = (0,0,0), L:x=3+2t, y=4+3t,z=5+4t 

For Exercises 9-10, find the point of intersection (if any) of the given lines. 
9. x=7+3s, y=-4-38,z=-7-5s and x=1+6t, y=2+t, z=3-2t 


x-6 x-11 y-14 2+9 
10. =s = m auci 
0 y+3=z and 3 ó 2 


For Exercises 11-12, write the normal form of the plane P containing the point Q and per- 
pendicular to the vector n. 


11. Q- (5,1, -2), n = (4, -4,3) 12. Q =(6,-2,0), n = (2,6,4) 

For Exercises 13-14, write the normal form of the plane containing the given points. 
13. (1,0,3), (1,2,—1), (6,1,6) 14. (-3,1,—3), (4,—4,3), (0,0,1) 

15. Write the normal form of the plane containing the lines from Exercise 9. 

16. Write the normal form of the plane containing the lines from Exercise 10. 

For Exercises 17-18, find the distance D from the point Q to the plane P. 

17. Q = (4,1,2), P :3x-y-5z+8=0 18. Q = (0,2,0), P :-5x+2y-7z+1=0 
For Exercises 19-20, find the line of intersection (if any) of the given planes. 

19. x«+3y+2z-6=0, 2x-y+z2+2=0 20. 8x+y—5z=0,x+2y+z+4=0 

B 


-6 
21. Find the point(s) of intersection (if any) of the line É = y+3 = z with the plane 


x+38y+2z2-6=0. (Hint: Put the equations of the line into the equation of the plane.) 


40 CHAPTER 1. VECTORS IN EUCLIDEAN SPACE 


1.6 Surfaces 


In the previous section we discussed planes in Euclidean space. A plane is an example of 
a surface, which we will define informally? as the solution set of the equation F(x, y,z) = 0 
in R?, for some real-valued function F. For example, a plane given by ax - by cz ^d -0 
is the solution set of F(x, y,z) 2 0 for the function F(x,y,z) 2 ax - by cz - d. Surfaces are 
2-dimensional. The plane is the simplest surface, since it is “flat”. In this section we will 
look at some surfaces that are more complex, the most important of which are the sphere 
and the cylinder. 


Definition 1.9. A sphere S is the set of all points (x, y,z) in R? which are a fixed distance r 
(called the radius) from a fixed point P, = (xo, yo, Zo) (called the center of the sphere): 


S -((x,y,2): (x — xy? +y- y)? +(z -— 2)? =r} (1.29) 


Using vector notation, this can be written in the equivalent form: 
S ={x: |x-xl=r} 


where x = (x, y,z) and x, = (Xo, Yo, Zo) are vectors. 


Figure 1.6.1 illustrates the vectorial approach to spheres. 


17 |x—xll=r 


X 
(a) radius r, center (0,0,0) (b) radius r, center (xo, yo, zo) 


Figure 1.6.1 Spheres in R 


Note in Figure 1.6.1(a) that the intersection of the sphere with the xy-plane is a circle 
of radius r (i.e. a great circle, given by x? + y? = r? as a subset of R2). Similarly for the 
intersections with the xz-plane and the yz-plane. In general, a plane intersects a sphere 
either at a single point or in a circle. 


8See O'NEILL for a deeper and more rigorous discussion of surfaces. 
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Example 1.27. Find the intersection of the sphere x? + y? + z? = 169 with the plane z = 12. 


Solution: The sphere is centered at the origin and has radius 
13 = V169, so it does intersect the plane z = 12. Putting 
z = 12 into the equation of the sphere gives 
x? + y? 4 12? = 169 
x” +y? = 169-144 - 25 - 5? 


which is a circle of radius 5 centered at (0,0,12), parallel to 
the xy-plane (see Figure 1.6.2). Figure 1.6.2 


If the equation in formula (1.29) is multiplied out, we get an equation of the form: 
xt y? «2? +tax+by+cz+d=0 (1.31) 


for some constants a, b, c and d. Conversely, an equation of this form may describe a sphere, 
which can be determined by completing the square for the x, y and z variables. 


Example 1.28. Is 2x? + 2y? - 22? — 8x + Ay — 16z + 10 = 0 the equation of a sphere? 
Solution: Dividing both sides of the equation by 2 gives 


x? 4 y? c2? -Ax 2y - 8245-20 
(x? — Ax - 4) - (9? + 2y - 1) - (22-82 4-16) -5-4-1-16 20 
(x 2)? + (y - 1? + (z - 4? = 16 


which is a sphere of radius 4 centered at (2, —1,4). 


Example 1.29. Find the points(s) of intersection (if any) of the sphere from Example 1.28 
and the linex =3+t, y=1+2t, z=3-t. 


Solution: Put the equations of the line into the equation of the sphere, which was (x — 2)? + 
(y+ 1)? +(z-4)? = 16, and solve for t: 
(34+ :—2Y? - (14 2t - 1? - (38-t- 4? - 16 
(t+ 1? + (21 2  (-t— 1? = 16 
61? 12t - 10-0 


4 
The quadratic formula gives the solutions t= -1- Js Putting those two values into the 
equations of the line gives the following two points of intersection: 


" 4 i 8 " 4 d 2 4 i 8 j 4 
Tn +=; — — an e E P T — 
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If two spheres intersect, they do so either at a single point or in a circle. 


Example 1.30. Find the intersection (if any) of the spheres x? y? +z? = 25 and x? + y? * (2 — 
2)? = 16. 


Solution: For any point (x,y,z) on both spheres, we see that 


x? + y? 2 25 — 2?, and 

x?4 y? = 16 - (z - 2Y?, so 
4z-4=9 > 2=13/4 

x? 4 y? = 25 — (13/4)? = 231/16 


x2 +y? +z2=25 > 
x? +y? +(z-2}2=16 > 
16—(z-2)?=25-27 > 
5 


.'. The intersection is the circle x? + y? = 231 of radius vet = 3.8 centered at (0,0, 18), 


The cylinders that we will consider are right circular cylinders. These are cylinders ob- 
tained by moving a line L along a circle C in R? in a way so that L is always perpendicular 
to the plane containing C. We will only consider the cases where the plane containing C is 
parallel to one of the three coordinate planes (see Figure 1.6.3). 


EX 


(a) x? +y? 2 r2, any z (b) x24 z2 2 r2, any y (c) y24+z -r^,anyx 


2 2 


Figure 1.6.3 Cylinders in R 


For example, the equation of a cylinder whose base circle C lies in the xy-plane and is 
centered at (a, 5,0) and has radius r is 


(x -aP (y - bY =r?, (1.32) 


where the value of the z coordinate is unrestricted. Similar equations can be written when 
the base circle lies in one of the other coordinate planes. A plane intersects a right circular 
cylinder in a circle, ellipse, or one or two lines, depending on whether that plane is parallel, 
oblique?, or perpendicular, respectively, to the plane containing C. The intersection of a 
surface with a plane is called the trace of the surface. 


3i e. at an angle strictly between 0? and 90°. 
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The equations of spheres and cylinders are examples of second-degree equations in R?, i.e. 
equations of the form 


Ax?^- By! Cz? 4 Dxy «Exe Fyz- Gx - Hy & Iz 4 J 20 (1.33) 


for some constants A, B, ..., J. If the above equation is not that of a sphere, cylinder, plane, 
line or point, then the resulting surface is called a quadric surface. 


One type of quadric surface is the ellipsoid, given 

by an equation of the form: 

x^ y^ z 

— += + =l 1.34 

a? b œe NDS) 
In the case where a = b = c, this is just a sphere. 
In general, an ellipsoid is egg-shaped (think of an 
ellipse rotated around its major axis). Its traces in 
the coordinate planes are ellipses. Figure 1.6.4 Ellipsoid 


Two other types of quadric surfaces are the hyperboloid of one sheet, given by an 
equation of the form: 


~+5-5=-1 (1.35) 
Cc 


Bet =1 (1.36) 


Figure 1.6.5 Hyperboloid of one sheet Figure 1.6.6 Hyperboloid of two sheets 
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For the hyperboloid of one sheet, the trace in any plane parallel to the xy-plane is an 
ellipse. The traces in the planes parallel to the xz- or yz-planes are hyperbolas (see Figure 
1.6.5), except for the special cases x = ta and y = +b; in those planes the traces are pairs of 
intersecting lines (see Exercise 8). 

For the hyperboloid of two sheets, the trace in any plane parallel to the xy- or xz-plane is 
a hyperbola (see Figure 1.6.6). There is no trace in the yz-plane. In any plane parallel to the 
yz-plane for which |x| > |a], the trace is an ellipse. 


The elliptic paraboloid is another type of quadric surface, 
whose equation has the form: 


x? y? z 


» + Bho Ge (1.37) 
The traces in planes parallel to the xy-plane are ellipses, though 
in the xy-plane itself the trace is a single point. The traces in 
planes parallel to the xz- or yz-planes are parabolas. Figure 
1.6.7 shows the case where c > 0. When c < 0 the surface is 
turned downward. In the case where a = b, the surface is called x 

a paraboloid of revolution, which is often used as a reflecting sur- Figure 1.6.7 Paraboloid 
face, e.g. in vehicle headlights.!? 

A more complicated quadric surface is the hyperbolic paraboloid, given by: 


7 B^ (1.38) 


100 - 
50 y> y ez, 
PD eee 
d 0 CPI 
te -10 
-50 J T ; 
AL LAO 
= LT LTT AABN 
100,6 $ DUE f 
HT Pt 
THU x 


10 10 


Figure 1.6.8 Hyperbolic paraboloid 


10 For a discussion of this see pp. 157-158 in HECHT. 


1.6 Surfaces 45 


The hyperbolic paraboloid can be tricky to draw; using graphing software on a computer 
can make it easier. For example, Figure 1.6.8 was created using the free Gnuplot package 
(see Appendix C). It shows the graph of the hyperbolic paraboloid z = y? — x?, which is the 
special case where a = b = 1 and c = - 1 in equation (1.38). The mesh lines on the surface are 
the traces in planes parallel to the coordinate planes. So we see that the traces in planes 
parallel to the xz-plane are parabolas pointing upward, while the traces in planes parallel 
to the yz-plane are parabolas pointing downward. Also, notice that the traces in planes 
parallel to the xy-plane are hyperbolas, though in the xy-plane itself the trace is a pair of 
intersecting lines through the origin. This is true in general when c « 0 in equation (1.38). 
When c » 0, the surface would be similar to that in Figure 1.6.8, only rotated 90? around 
the z-axis and the nature of the traces in planes parallel to the xz- or yz-planes would be 
reversed. 


The last type of quadric surface that we will consider is the 
elliptic cone, which has an equation of the form: 


x^ y* z 


— + — — — 
a? b? œ 


=0 (1.39) 


The traces in planes parallel to the xy-plane are ellipses, ex- 
cept in the xy-plane itself where the trace is a single point. 
The traces in planes parallel to the xz- or yz-planes are hyper- 
bolas, except in the xz- and yz-planes themselves where the 
traces are pairs of intersecting lines. M 

Notice that every point on the elliptic cone is on a line which 
lies entirely on the surface; in Figure 1.6.9 these lines all go 
through the origin. This makes the elliptic cone an example of 
a ruled surface. The cylinder is also a ruled surface. 

What may not be as obvious is that both the hyperboloid of one sheet and the hyperbolic 
paraboloid are ruled surfaces. In fact, on both surfaces there are two lines through each 
point on the surface (see Exercises 11-12). Such surfaces are called doubly ruled surfaces, 
and the pairs of lines are called a regulus. 

It is clear that for each of the six types of quadric surfaces that we discussed, the surface 
can be translated away from the origin (e.g. by replacing x? by (x—x,)? in its equation). It can 
be proved!! that every quadric surface can be translated and/or rotated so that its equation 
matches one of the six types that we described. For example, z = 2xy is a case of equation 
(1.33) with “mixed” variables, e.g. with D # 0 so that we get an xy term. This equation does 
not match any of the types we considered. However, by rotating the x- and y-axes by 45? in 
the x y-plane by means of the coordinate transformation x = (x' —y' V2, y = (x! +y v2, z= 2’, 
then z = 2xy becomes the hyperbolic paraboloid z' = (x’)? — (y)? in the (x', y', 2") coordinate 
system. That is, z = 2xy is a hyperbolic paraboloid as in equation (1.38), but rotated 45° in 
the x y-plane. 


Ye 


Figure 1.6.9 Elliptic cone 


11S¢e Ch. 7 in POGORELOV. 
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: 


For Exercises 1-4, determine if the given equation describes a sphere. If so, find its radius 
and center. 


1. x? + y? +z? - Ax -6y 102-37 20 2. x? +y? c 22 2x -2y 82 19-0 
3. 2x? .- 2y? +22? c Ax - Ay c Az -44 «0 4. x24 y? - 22 12x - 2y - 42-320 


5. Find the point(s) of intersection of the sphere (x — 3)? + (y + 1)? + (z — 3? = 9 and the line 
x=-1+2t, y=-2-3t,z=3+t. 


B 
6. Find the intersection of the spheres x24 y? +2? 2 9 and (x - A2 + (y+ 2)? + (z-4)? =9. 
7. Find the intersection of the sphere x? + y? +z? = 9 and the cylinder x? + y? = 4. 


8. Find the trace of the hyperboloid of one sheet 5 + ¥ — z5 = 1 in the plane x =a, and the 
trace in the plane y= b. 


y? 
2 


9. Find the trace of the hyperbolic paraboloid 5 - gz = = in the xy-plane. 
C 


10. It can be shown that any four noncoplanar points (i.e. points that do not lie in the same 
plane) determine a sphere.!? Find the equation of the sphere that passes through the 
points (0,0,0), (0,0,2), (1, 24,3) and (0, —1,3). (Hint: Equation (1.31)) 


11. Show that the hyperboloid of one sheet is a doubly ruled surface, i.e. each point on 
the surface is on two lines lying entirely on the surface. (Hint: Write equation (1.35) as 


2 2 2 A e " D 
*-%=1-4H, factor each side. Recall that two planes intersect in a line.) 
a c b 


12. Show that the hyperbolic paraboloid is a doubly ruled surface. (Hint: Exercise 11) 


13. Let S be the sphere with radius 1 centered at (0,0, 1), 

and let S* be S without the *north pole" point (0,0,2). Let 
(a,b,c) be an arbitrary point on S*. Then the line passing 
through (0,0,2) and (a, b, c) intersects the x y-plane at some 
point (x, y,0), as in Figure 1.6.10. Find this point (x, y,0) in 
terms of a, b and c. 
(Note: Every point in the xy-plane can be matched with a 
point on S*, and vice versa, in this manner. This method is 
called stereographic projection, which essentially identifies 
all of R? with a “punctured” sphere.) 


Figure 1.6.10 


12See WELCHONS and KRICKENBERGER, p. 160, for a proof. 
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1.7 Curvilinear Coordinates 


The Cartesian coordinates of a point (x,y,z) are determined by 
following straight paths starting from the origin: first along the 
x-axis, then parallel to the y-axis, then parallel to the z-axis, as 
in Figure 1.7.1. In curvilinear coordinate systems, these paths can 
be curved. The two types of curvilinear coordinates which we will 
consider are cylindrical and spherical coordinates. Instead of ref- 
erencing a point in terms of sides of a rectangular parallelepiped, 
as with Cartesian coordinates, we will think of the point as ly- 
ing on a cylinder or sphere. Cylindrical coordinates are often used when there is symmetry 
around the z-axis; spherical coordinates are useful when there is symmetry about the origin. 

Let P = (x,y,z) be a point in Cartesian coordinates in R?, and let P, = (x, y,0) be the 
projection of P upon the xy-plane. Treating (x,y) as a point in R?, let (r,0) be its polar 
coordinates (see Figure 1.7.2). Let p be the length of the line segment from the origin to P, 
and let $ be the angle between that line segment and the positive z-axis (see Figure 1.7.3). 
$ is called the zenith angle. Then the cylindrical coordinates (r,0,2) and the spherical 
coordinates (0,6, ) of P(x, y,z) are defined as follows:i? 


Figure 1.7.1 


Cylindrical coordinates (r,0,z): 


x=rcos0 r= x? +y? 


y=rsin0 0 -tan !(2) ` 
z-z z-z 
vis y Po(x, y,0) 
where 0x0zz if y20 and x«0«2mz if y<0 
Figure 1.7.2 


Cylindrical coordinates 


Spherical coordinates (0,0, 4): P(x,y,z) 
x = psingd cos0 po wy x24 y? 422? d 
. ivy d 
y = psing sind 0-tan (Žž) , E 
z = pcos $= cos) è 
V xteybez? pA y P(x, y,0) 
where 0x0zz if y20 and x«0«2mz if y<0 Figure 1.7.3 


Spherical coordinates 
Both 0 and $ are measured in radians. Note that r 20,00«2z, pz 0andO0zozzm. 
Also, 0 is undefined when (x, y) = (0,0), and $ is undefined when (x, y, z) = (0,0,0). 


13This “standard” definition of spherical coordinates used by mathematicians results in a left-handed system. 
For this reason, physicists usually switch the definitions of 0 and ¢ to make (p,0,@) a right-handed system. 
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Example 1.31. Convert the point (—2,—2,1) from Cartesian coordinates to (a) cylindrical 
and (b) spherical coordinates. 


Solution: (a) r = y (-2? + (-2)? = 2/2, 0 = tan 1 (=3) = tan (1) = 27, since y= -2 « 0. 
700,2) - (v8,82,1) 


(b) p = V(-2)? + (-2 + 1? = V9 -8, 9 = cos ! (4) « 1.23 radians. 
<. (p,0,) = (3,22,1.23) 


For cylindrical coordinates (r,0,2), and constants ry, 0, and Zo, we see from Figure 1.7.4 
that the surface r =r, is a cylinder of radius r, centered along the z-axis, the surface 0 = 0, 
is a half-plane emanating from the z-axis, and the surface z = z, is a plane parallel to the 
xy-plane. 


Az 
0 y 
0 
y 
x ! EX 
(b) 0 = 0o (c) z= zo 


Figure 1.7.4 Cylindrical coordinate surfaces 


For spherical coordinates (p,0,@), and constants po, 0, and bo, we see from Figure 1.7.5 
that the surface p = p, is a sphere of radius p, centered at the origin, the surface 0 = 0, is a 
half-plane emanating from the z-axis, and the surface $ = 4, is a circular cone whose vertex 
is at the origin. 


0 1 _ 


(b) 08-6, (e) 9 - $o 


Figure 1.7.5 Spherical coordinate surfaces 


Figures 1.7.4(a) and 1.7.5(a) show how these coordinate systems got their names. 
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Sometimes the equation of a surface in Cartesian coordinates can be transformed into a 
simpler equation in some other coordinate system, as in the following example. 


Example 1.32. Write the equation of the cylinder x? + y? = 4 in cylindrical coordinates. 
Solution: Since r = y x? + y?, then the equation in cylindrical coordinates is r = 2. 


Using spherical coordinates to write the equation of a sphere does not necessarily make 
the equation simpler, if the sphere is not centered at the origin. 


Example 1.33. Write the equation (x — 2)? + (y — 1? +z? = 9 in spherical coordinates. 
Solution: Multiplying the equation out gives 


x? y? +z? -Ax -2y 5-9 , SO we get 
p? — Apsin $ cos0 —2psing sin0 —4=0, or 
p? - 2sin$(2cos0 + sin@)p—4=0 


after combining terms. Note that this actually makes it more difficult to figure out what the 
surface is, as opposed to the Cartesian equation where you could immediately identify the 
surface as a sphere of radius 3 centered at (2, 1,0). 


Example 1.34. Describe the surface given by 0 = z in cylindrical coordinates. 


Solution: 'This surface is called a helicoid. As the (vertical) z coordinate increases, so does 
the angle 0, while the radius r is unrestricted. So this sweeps out a (ruled!) surface shaped 
like a spiral staircase, where the spiral has an infinite radius. Figure 1.7.6 shows a section 
of this surface restricted to 0 < z < 4; and Ox r x 2. 


Figure 1.7.6 Helicoid 0 =z 
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A 


For Exercises 1-4, find the (a) cylindrical and (b) spherical coordinates of the point whose 
Cartesian coordinates are given. 


1. (2,2/3,-1) 2. (-5,5,6) 3. (V21, -V/7,0) 4. (0, 2,2) 

For Exercises 5-7, write the given equation in (a) cylindrical and (b) spherical coordinates. 
5. x?4 y? +27 225 6. x? + y?-2y 7. x? + y? +92? = 36 

B 


8. Describe the intersection of the surfaces whose equations in spherical coordinates are 
0-5 and p=. 


9. Show that for a 4 0, the equation p = 2asin@cosé@ in spherical coordinates describes a 
sphere centered at (a,0,0) with radius |a |. 


C 


10. Let P = (a,0,4) be a point in spherical coordinates, with a > 0 and 0 < ġ < zx. Then P 
lies on the sphere p =a. Since 0 < $ < x, the line segment from the origin to P can be 
extended to intersect the cylinder given by r =a (in cylindrical coordinates). Find the 
cylindrical coordinates of that point of intersection. 


11. Let P, and P, be points whose spherical coordinates are (0,,0,, d) and (05,0,, 92), respec- 
tively. Let v, be the vector from the origin to P,, and let v, be the vector from the origin 
to P,. For the angle y between v; and vz, show that 


cosy = cos f, cos h, + sing, sin» cos(0, — 0). 


This formula is used in electrodynamics to prove the addition theorem for spherical har- 
monics, which provides a general expression for the electrostatic potential at a point due 
to a unit charge. See pp. 100-102 in JACKSON. 


12. Show that the distance d between the points P, and P, with cylindrical coordinates 
(r,,0,,2,) and (r2,02, Z2), respectively, is 


d= A r?«r2-2r,r,cos(0, 6.) c (22-21). 


13. Show that the distance d between the points P, and P, with spherical coordinates 
(0,,0,,,) and (p,,0,, 2), respectively, is 


d= V p?  p2 — 2p, p, [sin p, sind, cos(0, — 0,) + cos, cos dy]. 
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1.8 Vector-Valued Functions 


Now that we are familiar with vectors and their operations, we can begin discussing func- 
tions whose values are vectors. 


Definition 1.10. A vector-valued function of a real variable is a rule that associates a 


vector f(t) with a real number t, where t is in some subset D of R! (called the domain of f). 
We write f: D — R? to denote that f is a mapping of D into R?. 


For example, f(t) = ti + ¢?j + t?k is a vector-valued function in R?, defined for all real num- 
bers t. We would write f : R — R?. At t = 1 the value of the function is the vector i+j+k, 
which in Cartesian coordinates has the terminal point (1, 1, 1). 

A vector-valued function of a real variable can be written in component form as 


f(t) = fii + fa + fF OK 


or in the form 


f(t)- (FG), f(t), f.» 


for some real-valued functions f,(t), f2(¢), f;(t), called the component functions of f. The first 
form is often used when emphasizing that f(t) is a vector, and the second form is useful 
when considering just the terminal points of the vectors. By identifying vectors with their 
terminal points, a curve in space can be written as a vector-valued function. 


Example 1.35. Define f: R — R? by f(t) = (cost, sint, t). 

This is the equation of a helix (see Figure 1.8.1). As the value of 
t increases, the terminal points of f(t) trace out a curve spiraling 
upward. For each f, the x- and y-coordinates of f(t) are x = cost 
and y = sint, so 


x? + y? = cos? t 4 sin? t - 1. 


Thus, the curve lies on the surface of the right circular cylinder 
x? y? — 1. 


Figure 1.8.1 


It may help to think of vector-valued functions of a real variable in R? as a generalization 
of the parametric functions in R? which you learned about in single-variable calculus. Much 
of the theory of real-valued functions of a single real variable can be applied to vector-valued 
functions of a real variable. Since each of the three component functions are real-valued, it 
will sometimes be the case that results from single-variable calculus can simply be applied 
to each of the component functions to yield a similar result for the vector-valued function. 
However, there are times when such generalizations do not hold (see Exercise 13). The 
concept of a limit, though, can be extended naturally to vector-valued functions, as in the 
following definition. 
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Definition 1.11. Let f(t) be a vector-valued function, let a be a real number and let c be a 
vector. Then we say that the limit of f(t) as t approaches a equals c, written as limf) =E, 
a 


if lim | f(t) -ell = 0. If fŒ) = (f(t), fat), fs), then 


limf(e) = (lim f,@), lim f, lim f) 


provided that all three limits on the right side exist. 


The above definition shows that continuity and the derivative of vector-valued functions 
can also be defined in terms of its component functions. 


Definition 1.12. Let f(t) = (/,(@), f.(£), f.(t)) be a vector-valued function, and let a be a real 

number in its domain. Then f(t) is continuous at a if lim f(t) = f(a). Equivalently, f(t) is 
—a 

continuous at a if and only if f,(¢), f,(¢), and f;(t) are continuous at a. 


The derivative of f(t) at a, denoted by f'(a) or p is the limit 


f(a - h) — f(a) 
h 


f'(a) - lim 
h—0 


if that limit exists. Equivalently, f'(a) = (f, (a), f2 (a), f;'(a)), if the component derivatives 
exist. We say that f(t) is differentiable at a if f'(a) exists. 


Recall that the derivative of a real-valued function of a single variable is a real number, 
representing the slope of the tangent line to the graph of the function at a point. Similarly, 
the derivative of a vector-valued function is a tangent vector to the curve in space which 
the function represents, and it lies on the tangent line to the curve (see Figure 1.8.2). 

AZ 


— f'(a) 


EX 


Figure 1.8.2 Tangent vector f'(a) and tangent line L = f(a) + sf'(a) 


Example 1.36. Let f(t) = (cost,sint,t). Then f’(t) = (—sint,cost, 1) for all t. The tangent line 
L to the curve at f(27) = (1,0, 27) is L = f(2z) + s f'(27) = (1,0, 27) + s(0,1, 1), or in parametric 
form: x = 1, y = s, z = 2m +s for —co« s < oo. 
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A scalar function is a real-valued function. Note that if u(t) is a scalar function and 
f(t) is a vector-valued function, then their product, defined by (u f)(¢) = u(t)f(t) for all t, is a 
vector-valued function (since the product of a scalar with a vector is a vector). 

The basic properties of derivatives of vector-valued functions are summarized in the fol- 
lowing theorem. 


Theorem 1.20. Let f(t) and g(t) be differentiable vector-valued functions, let u(t) be a 
differentiable scalar function, let k be a scalar, and let c be a constant vector. Then 


Proof: The proofs of parts (a)-(e) follow easily by differentiating the component functions 
and using the rules for derivatives from single-variable calculus. We will prove part (f), 
and leave the proof of part (g) as an exercise for the reader. 

(f) Write f(t) = (f. (0), f(t), f:(t)) and g(t) = (e(t), g(t), g3(t)), where the component functions 
fit), FQ, f(t), gi, go(t), 8;(t) are all differentiable real-valued functions. Then 


d d 
qf E g(t) = 34 080 + f(t) g2(t) gr f3(t) g3(t)) 


d d d 
= 3; hs) + 3; 0 8:0 + gy fas) 


df, dg, dh, dg 
= DA og f Eo Loe f (07 


_ (hip deep Ufa), 
(FO 70, 70) G0, 80, 860) 


: (t) 


2 dfs dg 
; (t)+ q 080 +AA d 


dg, dg; dg; 
dt (5, dt (2), dt 


df dg 
2 = . * o — x ED 
= ; g(t) + f(t) 9 for all £ Q 


+(AO fO, f) | (t)] 
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Example 1.37. Suppose f(t) is differentiable. Find the derivative of ||f(£) ||. 
Solution: Since ||f(2)|| is a real-valued function of t, then by the Chain Rule for real-valued 


d d 
functions, we know that 3 IED = 2f z I ££) || . 


But || f(t) ||? = f(t) -f(2), so Zito? = L aoto. Hence, we have 


2lf(2 £ itol = L -to = f'(t)- f(t) + f(2)-f'(£) by Theorem 1.20(f), so 


= 2f'(t)-f(t) , so if ||f(2)]| Z 0 then 
f'(t)- f(t) 


d 
—|fi ET 
ae Ol 7 ^ei 


d 
We know that ||f(2)|| is constant if and only if d If(2)]| = O for all t. Also, f(t) L f'(2) if and 
only if f’(¢)- f(t) = 0. Thus, the above example shows this important fact: 


If ||f(¢)|| Z 0, then ||£(¢)|| is constant if and only if f(t) L f'(2) for all t. 


This means that if a curve lies completely on a sphere (or circle) centered at the origin, then 
the tangent vector f'(t) is always perpendicular to the position vector f(t). 


cost sint -at 
vira? Vitae V1i+a2t 
Figure 1.8.3 shows the graph of the curve when a = 0.2. In the exercises, the reader will be 
asked to show that this curve lies on the sphere x? + y? +z? = 1 and to verify directly that 
f'(t)- f(t) = 0 for all t. 


Example 1.38. The spherical spiral f(t) = ) for a 40. 


Figure 1.8.3 Spherical spiral with a = 0.2 
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Just as in single-variable calculus, higher-order derivatives of vector-valued functions are 
obtained by repeatedly differentiating the (first) derivative of the function: 


d"f d at 
dm ala 

We can use vector-valued functions to represent physical quantities, such as velocity, ac- 
celeration, force, momentum, etc. For example, let the real variable t represent time elapsed 
from some initial time (£ = 0), and suppose that an object of constant mass m is subjected 
to some force so that it moves in space, with its position (x,y,z) at time ¢ a function of 
t. That is, x = x(t), y = y(t), z = z(t) for some real-valued functions x(t), y(t), z(t). Call 
r(t) = (x(t), y(t), z(¢)) the position vector of the object. We can define various physical quan- 


tities associated with the object as follows: 


d d 
MO=THO, fUO-cPO, 0 ) (for n =2,3,4,...) 


position: r(t) = (x(t), y(t), z(£)) 
velocity: v(t) = x(t) = r'(t)= = 


= (x'(t), y (0), 2' (0) 


acceleration: a(t) = v(t) = v'(t) = a 
s d?r 
=r(d)=r"(t)= ET 


= (x" (t), y" (0), 2" (0) 
momentum: p(t) = mv(t) 


force: F(t) = p(t) = p(t) = (Newton’s Second Law of Motion) 


The magnitude || v(¢)|| of the velocity vector is called the speed of the object. Note that since 
the mass m is a constant, the force equation becomes the familiar F(t) = ma(t). 


Example 1.39. Let r(t) = (5cost,3sint,4sint) be the position vector of an object at time £ = 0. 
Find its (a) velocity and (b) acceleration vectors. 


Solution: (a) v(t) = r(t) = (-5sint,3cost,4cost) 
(b) a(t) = W(t) = (-5 cost, -3sint, —4sint) 


Note that ||r(¢)|| = V 25cos?t 4 25sin?t = 5 for all t, so by Example 1.37 we know that r(t)- 
r(¢) = 0 for all £ (which we can verify from part (a)). In fact, || v(¢)|| = 5 for all t also. And not 
only does r(t) lie on the sphere of radius 5 centered at the origin, but perhaps not so obvious 
is that it lies completely within a circle of radius 5 centered at the origin. Also, note that 
a(t) = —r(t). It turns out (see Exercise 16) that whenever an object moves in a circle with 
constant speed, the acceleration vector will point in the opposite direction of the position 
vector (i.e. towards the center of the circle). 


14We will often use the older dot notation for derivatives when physics is involved. 
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Recall from Section 1.5 that if r,, r, are position vectors to distinct points then r,+¢(r,—-r,) 
represents a line through those two points as £ varies over all real numbers. That vector 
sum can be written as (1— t)r; +tr,. So the function I(t) = (1— t)r, + tr, is a line through 
the terminal points of r, and r,, and when t is restricted to the interval [0,1] it is the line 
segment between the points, with 1(0) = r, and (1) = r,. 

In general, a function of the form f(t) = (a,t + b;,ast  b,, ast -- bs) represents a line in R3. A 
function of the form f(t) = (a t? + bit + c,,a,t? + bot + Cy, ast? + bgt + c3) represents a (possibly 
degenerate) parabola in R?. 


Example 1.40. Bézier curves are used in Computer Aided Design (CAD) to approximate 
the shape of a polygonal path in space (called the Bézier polygon or control polygon). For 
instance, given three points (or position vectors) by, b,, b, in R, define 


b(t) = (1- t)b, + tb, 
bi(t) = (1- tb, + th, 
b?(t) = (1 — tbi) tbi) 
- (1.- tb, + 21(1- t)b, + t?b, 


for all real t. For t in the interval [0, 1], we see that b/(£) is the line segment between b, and 
b,, and bi(¢) is the line segment between b, and b,. The function b?(:) is the Bézier curve 
for the points by, b,, b,. Note from the last formula that the curve is a parabola that goes 
through b, (when £ = 0) and b, (when t£ = 1). 

As an example, let b, = (0,0,0), b, = (1,2,3), and b, = (4,5,2). Then the explicit formula for 
the Bézier curve is b;(t) = (2t + 21? At + 12,6t — At2), as shown in Figure 1.8.4, where the line 
segments are bį(t) and b!(£), and the curve is b;(¢). 


(1,2,3) 


y 


Figure 1.8.4 Bézier curve approximation for three points 
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In general, the polygonal path determined by n = 3 noncollinear points in R? can be used 
to define the Bézier curve recursively by a process called repeated linear interpolation. This 
curve will be a vector-valued function whose components are polynomials of degree n — 1, 
and its formula is given by de Casteljau’s algorithm. In the exercises, the reader will be 
given the algorithm for the case of n = 4 points and asked to write the explicit formula for 
the Bézier curve for the four points shown in Figure 1.8.5. 


2-6 


Figure 1.8.5 Bézier curve approximation for four points 


A 

For Exercises 1-4, calculate f'(t) and find the tangent line at f(0). 

1. ft) =(¢+ 1,72 1,03 4 1) 2. f(t) - (e! - 1,6?! 1,0 +1) 
8. f(t) = (cos2t,sin2t,t) 4. f(t) = (sin2t,2sin? t,2cost) 


For Exercises 5-6, find the velocity v(t) and acceleration a(t) of an object with the given 
position vector r(t). 


5. v(t) = (t,t— sint, 1— cost) 6. r(t) = (3cost,2sint,1) 


B 


cost sint —at 
VI+a Vitae v1xa?8 
(a) Show that ||f(2)|| = 1 for all t. 


(b) Show directly that f'(£) - f(t) = 0 for all 7. 


7. Let f(t) = |; with a £0. 


8. If f'(2) = 0 for all ¢ in some interval (a,b), show that f(t) is a constant vector in (a,b). 


15 See pp. 27-30 in FARIN. 
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9. For a constant vector c Z 0, the function f(t) = te represents a line parallel to c. 
(a) What kind of curve does g(t) = tèc represent? Explain. 
(b) What kind of curve does h(t) = ete represent? Explain. 


(c) Compare f'(0) and g'(0). Given your answer to part (a), how do you explain the 
difference in the two derivatives? 


d df d?f 
10. Show that d =) sfx. 


11. Let a particle of (constant) mass m have position vector r(£), velocity v(t), acceleration 
a(t) and momentum p(t) at time t. The angular momentum L(t) of the particle with 
respect to the origin at time t is defined as L(t) = r(t) x p(t). If F(t) is the force acting on 
the particle at time £, then define the torque N(t) acting on the particle with respect to 
the origin as N(7) = r(t) x F(t). Show that L'(2) = N(1). 


d _ df dg dh 
12. Show that 7 (f-(g x h) = =- (g x h) + f- En x h) +f- (g x a 


13. The Mean Value Theorem does not hold for vector-valued functions: Show that for f(t) = 
(cost, sint, t), there is no ¢ in the interval (0,27) such that 


f(27) — f(0) 


f'(t)- 
(t) TRENT 


C 


14. The Bézier curve b;(¢) for four noncollinear points by, b,, b, b; in R? is defined by the 
following algorithm (going from the left column to the right): 


bi\)=(1-Obo+th,  bi0-(üü-0Ob;GD-tbi — b;(0-(u-0bj;(0)- tbi) 
bií)-(-2Db;-tb,  bi(0-(u-0bij(G)- tbt) 
b(t) = (1- t)b, + tb; 


(a) Show that bt) = (1— t? b, + 3t(1— t)?b, + 3¢7(1 — t)b, + t?b,. 


(b) Write the explicit formula (as in Example 1.40) for the Bézier curve for the points 
b, = (0,0, 0), b, = (0, 1, 1), b, = (2,3,0), b; = (4, 5, 2). 


15. Let r(t) be the position vector for a particle moving in R?. Show that 


Tex (v x r) 2 Irl?a- (r- v)v - (Iv I? +4r- adr. 


16. Let r(t) be the position vector in R? for a particle moving at constant speed c > 0 ina 
circle of radius a > 0 in the xy-plane. Show that a(t) points in the opposite direction as 
r(¢) for all t. (Hint: Use Example 1.37 to show that r(t) L v(t) and a(t) L v(¢)). 


17. Prove Theorem 1.20(g). 
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1.9 Arc Length 


Let r(t) = (x(t), y(t), z(t)) be the position vector of an object moving in R?. Since || v(¢)|| is the 
speed of the object at time £, it seems natural to define the distance s traveled by the object 
from time £ =a to t= b as the definite integral 


b b 
se] Ivotat- | V x19 + y'(t -z'(? dt, (1.40) 


which is analogous to the case from single-variable calculus for parametric functions in R2. 
This is indeed how we will define the distance traveled and, in general, the arc length of a 
curve in R. 


Definition 1.13. Let f(t) = (x(t), y(t), z(t)) be a curve in Rè whose domain includes the inter- 
val [a,b]. Suppose that in the interval (a,b) the first derivative of each component function 
x(t), y(t) and z(t) exists and is continuous, and that no section of the curve is repeated. Then 


the arc length L of the curve from t =a to t= b is 


b b 
L= | ifa | V x'(? + y'(t - z'(D?dt (1.41) 


A real-valued function whose first derivative is continuous is called continuously differ- 
entiable (or a @! function), and a function whose derivatives of all orders are continuous 
is called smooth (or a 6” function). All the functions we will consider will be smooth. A 
smooth curve f(t) is one whose derivative f'(t) is never the zero vector and whose component 
functions are all smooth. 

Note that we did not prove that the formula in the above definition actually gives the 
length of a section of a curve. À rigorous proof requires dealing with some subtleties, nor- 
mally glossed over in calculus texts, which are beyond the scope of this book.!6 


Example 1.41. Find the length L of the helix f(t) = (cost,sint,t) from t = 0 to t = 27. 
Solution: By formula (1.41), we have 


2z 27 27 
=f V(Csint? + (cost? at= | Vs? t cos!t «1t | V2dt 
0 0 0 
= V2(21 - 0) = 2V 20 


Similar to the case in R?, if there are values of t in the interval [a,b] where the derivative 
of a component function is not continuous then it is often possible to partition [a,b] into 
subintervals where all the component functions are continuously differentiable (except at 
the endpoints, which can be ignored). The sum of the arc lengths over the subintervals will 
be the arc length over [a,b]. 


161 particular, Duhamel’s principle is needed. See the proof in TAYLOR and MANN, § 14.2 and § 18.2. 
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Notice that the curve traced out by the function f(t) = (cost,sint,t) from Example 1.41 is 
also traced out by the function g(t) = (cos2t,sin2t,21). For example, over the interval [0,7], 
g(t) traces out the same section of the curve as f(t) does over the interval [0, 27]. Intuitively, 
this says that g(t) traces the curve twice as fast as f(t). This makes sense since, viewing the 
functions as position vectors and their derivatives as velocity vectors, the speeds of f(t) and 
g(t) are |f'(£)]| = V2 and |g'(2)|| = 2/2, respectively. We say that g(t) and f(t) are different 
parametrizations of the same curve. 


Definition 1.14. Let C be a smooth curve in R? represented by a function f(t) defined on an 
interval [a,b], and let a : [c,d] — [a,b] be a smooth one-to-one mapping of an interval [c,d] 


onto [a,b]. Then the function g : [c,d] — R? defined by g(s) = f(a(s)) is a parametrization of 
C with parameter s. If a is strictly increasing on [c, d] then we say that g(s) is equivalent 
to f(t). 


s t f) 
[a,b] R? 


g(s) = f(a(s)) = f(t) 


Note that the differentiability of g(s) follows from a version of the Chain Rule for vector- 
valued functions (the proof is left as an exercise): 


Theorem 1.21. Chain Rule: If f(t) is a differentiable vector-valued function of t, and t = 
a(s) is a differentiable scalar function of s, then f(s) = f(a(s)) is a differentiable vector-valued 
function of s, and 


df df dt 
ds dtds 


(1.42) 


for any s where the composite function f(a(s)) is defined. 


Example 1.42. The following are all equivalent parametrizations of the same curve: 


f(t) = (cost, sint,t) for t in [0,27] 
g(s) = (cos2s,sin2s,2s) for s in [0,7] 


h(s) = (cos2zs,sin27:5s,275) for s in [0,1] 


To see that g(s) is equivalent to f(t), define a : [0,71] — [0,27] by a(s) 2 2s. Then a is smooth, 
one-to-one, maps [0,7] onto [0,27], and is strictly increasing (since a'(s) = 2 > 0 for all s). 
Likewise, defining a : [0,1] — [0,27] by a(s) = 2zs shows that h(s) is equivalent to f(t). 
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A curve can have many parametrizations, with different speeds, so which one is the best 
to use? In some situations the arc length parametrization can be useful. The idea behind 
this is to replace the parameter t, for any given smooth parametrization f(t) defined on [a,b], 
by the parameter s given by 


t 
š -s- [ I'l du. (1.43) 


In terms of motion along a curve, s is the distance traveled along the curve after time t 
has elapsed. So the new parameter will be distance instead of time. There is a natural 
correspondence between s and f: from a starting point on the curve, the distance traveled 
along the curve (in one direction) is uniquely determined by the amount of time elapsed, and 
vice versa. 

Since s is the arc length of the curve over the interval [a,t] for each ¢ in [a,b], then it is a 
function of t. By the Fundamental Theorem of Calculus, its derivative is 

j ds Cd f We" 
s(t)- rj =| If (u)lidu = If (^| for all t in [a,b]. 

Since f(t) is smooth, then ||f’(¢)|| > 0 for all ¢ in [a,b]. Thus s'(¢) > 0 and hence s(t) is strictly 
increasing on the interval [a,b]. Recall that this means that s is a one-to-one mapping of the 
interval [a,b] onto the interval [s(a),s(b)]. But we see that 


a b 
a= | If'G)ldu-0 and s(b)= | If'(u)l du =L = arc length from t =a to t =b 
a a 


So the function s : [a,b] — [0,L] is a one-to-one, differentiable a(s) 
mapping onto the interval [0,L]. From single-variable calculus, s 
we know that this means that there exists an inverse function — [0.L] [a,b] 
a : [0,L]— [a,b] that is differentiable and the inverse of s : [a,b] ^ E d 


[0,L]. That is, for each £ in [a,b] there is a unique s in [0,7] such 
that s = s(t) and t= a(s). And we know that the derivative of a is Figure 1.9.1 t= a(s) 


"^w NOR M 
sa) fals) 


So define the arc length parametrization f : [0, L] > R? by 


a'(s) 


f(s) = f(a(s)) for all s in [0,2]. 
Then f(s) is smooth, by the Chain Rule. In fact, f(s) has unit speed: 


f'(s) = f'(a(s))a'(s) by the Chain Rule, so 
- reo = , SO 


I £'Ca(8)) I 
lf(s)]| 2 1 for all s in [0,Z]. 


So the arc length parametrization traverses the curve at a “normal” rate. 
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In practice, parametrizing a curve f(£) by arc length requires you to evaluate the integral 
s = f! |f'(u)l du in some closed form (as a function of t) so that you could then solve for t in 
terms of s. If that can be done, you would then substitute the expression for ¢ in terms of s 
(which we called a(s)) into the formula for f(t) to get f(s). 


Example 1.43. Parametrize the helix f(t) = (cost, sint, t), for t in [0,27], by arc length. 
Solution: By Example 1.41 and formula (1.43), we have 


t t 
a) ifwidu= | V2du = V2t for all t in [0,27]. 
0 0 


. S 
So we can solve for t in terms of s: t = a(s) = —. 


v2 


s ) for all s in [0,2vV2x]. Note that |If'(9)|| = 1. 


'. f(s)= (cos 2 smn, > 
v2 v3 V2 
Arc length plays an important role when discussing curvature and moving frame fields, 
in the field of mathematics known as differential geometry." The methods involve using 
an arc length parametrization, which often leads to an integral that is either difficult or 
impossible to evaluate in a simple closed form. The simple integral in Example 1.43 is 
the exception, not the norm. In general, arc length parametrizations are more useful for 
theoretical purposes than for practical computations.!® Curvature and moving frame fields 
can be defined without using arc length, which makes their computation much easier, and 
these definitions can be shown to be equivalent to those using arc length. We will leave this 
to the exercises. 
The arc length for curves given in other coordinate systems can also be calculated: 


Theorem 1.22. Suppose that r = r(t), 0 = 0(t) and z = z(t) are the cylindrical coordinates of 
a curve f(t), for t in [a,b]. Then the arc length L of the curve over [a,b] is 


b 
L- f Vr'(t)? + r(t0'(t -z'(tdt (1.44) 


Proof: The Cartesian coordinates (x(t), y(t), z(t)) of a point on the curve are given by 
x(t)=r(t)cos@(t), y(t)-r(t)sin0(t), z(t)-z(t) 
so differentiating the above expressions for x(t) and y(t) with respect to t gives 


x'(t) 2 r'(t)cos0(t) - r(£)0'(t)sin0(t), y'(t) 2 r'(t)sin0(t) + r(2)0'(t) cos0(£) 


17See O'NEILL for an introduction to elementary differential geometry. 

18For example, the usual parametrizations of Bézier curves, which we discussed in Section 1.8, are polynomial 
functions in R?. This makes their computation relatively simple, which, in CAD, is desirable. But their arc 
length parametrizations are not only not polynomials, they are in fact usually impossible to calculate at all. 
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and so 


x (0? + y'(0? = (r'(t) cos O(t) — r(00 (t)sin9()? + (r'(t)sin0(0 4 r(00' t) cost)? 
= r'(t)*(cos? 0 + sin? 0) + r(t)?0' (t (cos? 0 + sin? 0) 
— 2r (t)r(t)0'(t) cos0 sin0 + 2r '(t)r(t)0'(1) cos0 sind 
-r'(t -r(t0' (t, and so 


b 
L-| Vx) + y(t)? -z'( dt 
b 
-f v r'(t + r(t0'(t -z'(t? dt QED 


Example 1.44. Find the arc length L of the curve whose cylindrical coordinates are r = ef, 
0 =t and z = ef, for t over the interval [0,1]. 


Solution: Since r'(t) = et, 0'(t)= 1 and z'(t) = et, then 
L= [Vr OPPO Pat 
- [ Verma Fat 
= [ ev8at- Ven 


2n Exercises 1-3, calculate the arc length of f(t) over the given interval. 
1. f(t) = (8cos 2¢,3sin2t, 3t) on [0,7/2] 

2. f(t) = (t?  1)cost, (t? + Isint, 2V2t) on [0,1] 

3. f(t) = (2cos3t, 2sin3t, 2t?) on [0,1] 

4, Parametrize the curve from Exercise 1 by arc length. 

5. Parametrize the curve from Exercise 3 by arc length. 

B 

6. Let f(t) be a differentiable curve such that f(t) 4 0 for all t. Show that 


d | f(t) J- f(t) x (f'(t) x (2) 
dt V |fc)| ROTE 
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Exercises 7-9 develop the moving frame field T, N, B at a point on a curve. 


7. Let f(t) be a smooth curve such that f'(7) Z 0 for all t. Then we can define the unit tangent 
vector T by 
| f'(t) 
[FOIE 


Show that 
f'(t) x (f(t) x F'O) 


T'(t)= 
i IEE) 


8. Continuing Exercise 7, assume that f'(t) and f”(t) are not parallel. Then T'(7) Z 0 so we 
can define the unit principal normal vector N by 


T(t) 
N(t) = ——. 
(07 Toi 


Show that 
_ f'(0 x EO x PO) 


N(t) = —————————. 
IEI | £" (2) x f'E) 
9. Continuing Exercise 8, the unit binormal vector B is defined by 
B(t) = T(t) x N(¢). 


Show that 
f'(t) x f"(t) 
IEE) x PO 
Note: The vectors T(t), N(£) and B(£) form a right-handed system of mutually perpendic- 
ular unit vectors (called orthonormal vectors) at each point on the curve f(t). 


B(t) = 


10. Continuing Exercise 9, the curvature x is defined by 


JT IEH x EE x £C 


KU eg OR 


Show that 
= IE) x f° || 


O= FOI 


Note: x(t) gives a sense of how “curved” the curve f(t) is at each point. 


and that T’(t) = IF ÐI x(t)N(¢). 


11. Find T, N, B and x at each point of the helix f(t) = (cost, sint, t). 


12. Show that the arc length L of a curve whose spherical coordinates are p = p(t), 0 = 0(t) 
and $ = p(t) for t in an interval [a,b] is 


b 
L- f V pt? + (p(t)? sin? f(t) 0 (4)? + p(t)2'(t)? dt. 


2 Functions of Several Variables 


2.1 Functions of Two or Three Variables 


In Section 1.8 we discussed vector-valued functions of a single real variable. We will now 
examine real-valued functions of a point (or vector) in R? or R?. For the most part these 
functions will be defined on sets of points in R?, but there will be times when we will use 
points in R?, and there will also be times when it will be convenient to think of the points as 
vectors (or terminal points of vectors). 

A real-valued function f defined on a subset D of R? is a rule that assigns to each point 
(x, y) in D a real number f(x, y). The largest possible set D in R? on which f is defined is 
called the domain of f, and the range of f is the set of all real numbers f(x,y) as (x, y) 
varies over the domain D. A similar definition holds for functions f(x,y,z) defined on points 
(x,y,z) in R. 


Example 2.1. The domain of the function 


f(x,y) =xy 


is all of R?, and the range of f is all of R. 
Example 2.2. The domain of the function 


1 
f(x,y) = — 
x-y 


is all of R? except the points (x, y) for which x = y. That is, the domain is the set D = {(x, y) : 
x Z y). The range of f is all real numbers except 0. 


Example 2.3. The domain of the function 


f(x,y) =f 1-2? - y? 


is the set D = {(x, y) : x? + y? < 1}, since the quantity inside the square root is nonnegative if 


and only if 1— (x? + y?) 2 0. We see that D consists of all points on and inside the unit circle 
in R? (D is sometimes called the closed unit disk). The range of f is the interval [0,1] in R. 
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Example 2.4. The domain of the function 


x-y-z 


fGx,y,z)-e 


is all of R?, and the range of f is all positive real numbers. 


A function f(x, y) defined in R? is often written as z = f (x, y), as was mentioned in Section 
1.1, so that the graph of f(x,y) is the set {(x,y,z): z = f(x, y)) in Rè. So we see that this 
graph is a surface in R, since it satisfies an equation of the form F(x,y,z) = 0 (namely, 
F(x,y,z) = f(x,y)—z). The traces of this surface in the planes z = c, where c varies over R, 
are called the level curves of the function. Equivalently, the level curves are the solution 
sets of the equations f(x, y) = c, for c in R. Level curves are often projected onto the x y-plane 
to give an idea of the various "elevation" levels of the surface (as is done in topography). 


Example 2.5. The graph of the function 


sin y x? + y? 

vx? ^ y? 
is shown below. Note that the level curves (shown both on the surface and projected onto the 
x y-plane) are groups of concentric circles. 


f(x,y) = 


sin x? 4- y? 


Figure 2.1.1 The function f(x, y)= 


You may be wondering what happens to the function in Example 2.5 at the point (x, y) = 
(0,0), since both the numerator and denominator are 0 at that point. The function is not 
defined at (0,0), but the limit of the function exists (and equals 1) as (x, y) approaches (0,0). 
We will now state explicitly what is meant by the limit of a function of two variables. 
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Definition 2.1. Let (a,b) be a point in R?, and let f(x, y) be a real-valued function defined 
on some set containing (a,b) (but not necessarily defined at (a,b) itself). Then we say that 
the limit of f(x, y) equals L as (x, y) approaches (a,b), written as 


fe y-L, (2.1) 
CC 


if given any e > 0, there exists a ô > 0 such that 


|f (x, y) - L| «e whenever 0< /(x—-a *(y-b)? <6. 


A similar definition can be made for functions of three variables. The idea behind the 
above definition is that the values of f(x,y) can get arbitrarily close to L (i.e. within e of 
L) if we pick (x, y) sufficiently close to (a, b) (i.e. inside a circle centered at (a,b) with some 
sufficiently small radius 6). 

If you recall the “epsilon-delta” proofs of limits of real-valued functions of a single variable, 
you may remember how awkward they can be, and how they can usually only be done easily 
for simple functions. In general, the multivariable cases are at least equally awkward to go 
through, so we will not bother with such proofs. Instead, we will simply state that when the 
function f(x,y) is given by a single formula and is defined at the point (a,b) (e.g. is not some 
indeterminate form like 0/0) then you can just substitute (x, y) = (a, b) into the formula for 
f (x, y) to find the limit. 


Example 2.6. 
Um oe ee A 
(x,y) (1,2) x2 + y2 1242? 5 


since f(x, y) - z is properly defined at the point (1,2). 


Zu 


The major difference between limits in one variable and limits in two or more variables 
has to do with how a point is approached. In the single-variable case, the statement “x — a” 
means that x gets closer to the value a from two possible directions along the real number 
line (see Figure 2.1.2(a)). In two dimensions, however, (x, y) can approach a point (a,b) along 
an infinite number of paths (see Figure 2.1.2(b)). 


ay 
bw 
ud >< = pen M 
0 a x o | ' 
(a) x— ain R (b) (x, y) — (a,b) in R2 


Figure 2.1.2 "Approaching" a point in different dimensions 
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Example 2.7. 
lim X does not exist 
(x,5)-(0,0) xf + y 
Note that we can not simply substitute (x, y) = (0,0) into the function, since doing so gives an 
indeterminate form 0/0. To show that the limit does not exist, we will show that the function 
approaches different values as (x, y) approaches (0,0) along different paths in R2. To see this, 


suppose that (x, y) — (0,0) along the positive x-axis, so that y = 0 along that path. Then 
x0 
duy rr a 


along that path (since x > 0 in the denominator). But if (x, y) — (0,0) along the straight line 
y = x through the origin, for x > 0, then we see that 


x? 1 


f,y)- E "xax 2 


which means that f(x,y) approaches different values as (x, y) — (0,0) along different paths. 
Hence the limit does not exist. 


Limits of real-valued multivariable functions obey the same algebraic rules as in the 
single-variable case, as shown in the following theorem, which we state without proof. 


Theorem 2.1. Suppose that lim f(x,y) and lim g(x,y) both exist, and that k is 
(x,y)— (a,b) (x, y) (a,b) 


some scalar. Then: 


li E , = li ; + li i 
a eap Eoo | eee » | | UD » | 


(b lim E fG, y k[ _ lim 


(x, y) | 
(x,y)— (a,b) a 7 


—(a,b) 


(©) | lim aia lim f(x,y) || lim g(x,y) | 


(x,y)—(a, (x,y)— (a,b) (x,y)— (a,b) 


f(x,y) 
f(x,y) NECS bur b) OO ee oye 


— if 
(x EN bg(x,y) lim g(x,y) (x,y)— (a,b) 
(x,y)— (a,b) 


(d) 


(e) If|f(x,y) - L|  g(x,y) forall(x,y)andif lim  g(x,y)20,then lim  f(x,y)-L. 
(x,y)— (a,b) (x,)— (a,b) 


x,y 


Note that in part (e), it suffices to have |f (x, y) - L| < g(x, y) for all (x, y) “sufficiently close" 
to (a, b) (but excluding (a, 5) itself). 
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Example 2.8. Show that 
4 
li = - 0. 
(y) 0,0) x2 + y? 

Since substituting (x, y) = (0,0) into the function gives the indeterminate form 0/0, we need 
an alternate method for evaluating this limit. We will use Theorem 2.1(e). First, notice that 
yt =(/y?)* and so 0 < y* < (v/x2 « y2)^ for all (x, y). But (yx? 4 y2)^ = (x? + y2Y?. Thus, for 
all (x, y) Z (0,0) we have 


yt 


x2 + y2 


(x? + yy 


~ x24 y2 


=x7 + —0 as (x,y) — (0,0). 


4 


Therefore lim a a 0. 
(x,y) (0,0) x2 + y 


Continuity can be defined similarly as in the single-variable case. 


Definition 2.2. A real-valued function f(x,y) with domain D in RÊ is continuous at the 
point (a,b) in D if i lim  f(x,y) 2 f (a,b). We say that f(x, y) is a continuous function if 


3,3) (a,b) 
it is continuous at every point in its domain D. 


Unless indicated otherwise, you can assume that all the functions we deal with are con- 
tinuous. In fact, we can modify the function from Example 2.8 so that it is continuous on all 
of RÈ. 


Example 2.9. Define a function f(x, y) on all of R? as follows: 


0 if (x, y) = (0,0) 


flay=4 y 
"ox x ila.) 4,0) 


x 


Then f(x,y) is well-defined for all (x, y) in R? (i.e. there are no indeterminate forms for any 
(x, y)), and we see that 


b* 
f(x,y) = aaa be f(a,b) for (a,b) Z (0,0). 


lim 
(x,y)— (a,b) 
So since 
lin f(x,y)20-/(0,0) by Example 2.8, 
(x,y)— (0,0) 


then f(x, y) is continuous on all of RÊ. 
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A 
For Exercises 1-6, state the domain and range of the given function. 
1 
1. f(x,y) 2 x2 + y?-1 2. f(x,y)  ——z 
foy) o xt +y E 
2——3 x?41 
8. fx, y= yx^*- y*-4 4. f(x,y)= 2 
5. f(x,y,2)-7 sin(xyz) 6. f(x,y,z) = J(x—-1YXyz- 1) 
For Exercises 7-18, evaluate the given limit. 
. lim  cos(xy) 8. lim e" 
(x,y)— (0,0) (x,5)—(0,0) 
2. 2 2 
9. lim 2 10. lim ———; 
(x,5)—(0,0) x2 + y? (x,5)—(0,0) x? + y4 
2 2 2 
—2xy + 
1. lim TY 12. lim — 5 
(x,y)- (,-1) x—y (x,y)-(0,0) xf + y 
2 2 2.9 punit 
13. lim ~~ a. "ings 5579 
(x,)5.(,1 x-y (x,y)—(0,0) x-y 
Au 1 
15. lim y sin(xy) 16. lim  (x?45?)cos (>) 
(,)2(0,00 x2? + y? (x,)—(0,0) xy 
x 
17. lim — i I 
(x,y)—(0,0) y m Ne cos( =| 
B 


19. Show that f(x,y) = sige C Xm for ø > 0, is constant on the circle of radius r > 0 
centered at the origin. This function is called a Gaussian blur, and is used as a filter in 
image processing software to produce a “blurred” effect. 


20. DUDDUSE that f(x, y) € f (y, x) for all (x, y) in R2. Show that f (x, y) = f (y,x) for all (x, y) in 

R^. 
21. Use the substitution r = \/x? + y? to show that 

ha wt? 
G,3)2(0,00  \/x2 4 y2 

(Hint: You will need to use L'Hópital's Rule for single-variable limits.) 
C 
22. Prove Theorem 2.1(a) in the case of addition. (Hint: Use Definition 2.1.) 


23. Prove Theorem 2.1(b). 
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2.2 Partial Derivatives 


Now that we have an idea of what functions of several variables are, and what a limit of 
such a function is, we can start to develop an idea of a derivative of a function of two or more 
variables. We will start with the notion of a partial derivative. 


Definition 2.3. Let f(x,y) be a real-valued function with domain D in R?, and let (a,b) be 
a point in D. Then the partial derivative of f at (a, b) with respect to x, denoted by 
0 
fea, b), is defined as 
x 
Of . f(a*h,b)- f(a,b) 


EM. = lim ———————— 2.2 
ee ES: s 


ô 
and the partial derivative of f at (a,b) with respect to y, denoted by Ta b), is defined 
y 


as 


UL ey eiten f(a,b+h)-f(a,b) ' 
Oy h—0 h 


Note: The symbol 0 is pronounced “del”.! 


(2.3) 


Recall that the derivative of a function f(x) can be interpreted as the rate of change of 
that function in the (positive) x direction. From the definitions above, we can see that the 
partial derivative of a function f (x, y) with respect to x or y is the rate of change of f(x, y) in 
the (positive) x or y direction, respectively. What this means is that the partial derivative of 
a function f (x, y) with respect to x can be calculated by treating the y variable as a constant, 
and then simply differentiating f(x, y) as if it were a function of x alone, using the usual 
rules from single-variable calculus. Likewise, the partial derivative of f (x, y) with respect to 
y is obtained by treating the x variable as a constant and then differentiating f (x, y) as if it 
were a function of y alone. 


ô ô 
Example 2.10. Find S. (y) and x,y) for the function f(x, y) = x?y+ y?. 
x y 
Solution: Treating y as a constant and differentiating f(x,y) with respect to x gives 
ô 
Ti =2xy 
Ox 


and treating x as a constant and differentiating f(x, y) with respect to y gives 


of 


L (x,y) =x? +3y". 
Oy 


lIt is not a Greek letter. The symbol was first used by the mathematicians A. Clairaut and L. Euler around 
1740, to distinguish it from the letter d used for the *usual" derivative. 
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ac OF of . of of 
We will often simply write — and — instead of —(x, y) and —(x, y). 
Ox Oy Ox Oy 


ô ô in(xy? 
Example 2.11. Find 9r and Z for the function f(x, y) = Ao 
Óx Oy xe +1 
Solution: Treating y as a constant and differentiating f (x, y) with respect to x gives 


Of _ (x? + DG? cos(xy?)) - x) sin(xy?) 
Ox — (x? + 1 


and treating x as a constant and differentiating f(x, y) with respect to y gives 


Of  2xy cos(xy?) 
ôy | x41 ` 


ô ô 
Since both se and se are themselves functions of x and y, we can take their partial 
x y 


derivatives with respect to x and y. This yields the higher-order partial derivatives: 


O?f | OO O?f 0 (of 
aj sla) a27 aylay) 
Of  Oj(0f Of 0 (of 
Ovox ~ Oy =a Ox dy m) 
f 08 Of 0 (d°f 
3^3) a5 7551553] 
óf oo Of  2O(0f 
dy 0x? br) Ax Oy? s] 
QE 610 Of  o(0f 
EEO. TAT. 
f 07 OF f ðf 
ðxðyðx — 252) ðyðxðy | ETT, 


of of Of Of o» ð? 
Example 2.12. Find the partial derivatives or f f f f d f 


, —, —3, > —— an for the 
Ox’ Oy’ Ax?’ Ady?’ OyOx Ox dy 


function f(x, y) = er yy xy? 
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Solution: Proceeding as before, we have 


ô ô 
er - 2xye*? y? or = x29 I 4 3xy? 
Ox dy 
Of ð 2 af ð 
Sofa (0 WY 4 3 —L = (42 07 943 2 
auta a a q og C9 
= 2ye*? + 4x? ye" = xte”? + 6xy 
8f f ð 
2 x? Y4 E dl 2 x »43 2 
ðyðx - Zi dd 7 ? OxÓy ap i on) 
= MM +37 = 2xe* ? + 2x3 ye") +3y? 


Higher-order partial derivatives that are taken with respect to different variables, such 
as $e me a zt , are called mixed partial derivatives. Notice in the above gor that 
fend 2:05 d. It turns that this will usually be the case. Specifically, whenever both or y L and 
I are continuous at a point (a,b), then they are equal at that point.? All the functions 
we will deal with will have continuous partial derivatives of all orders, so you can assume in 


the remainder of the text that 


Ea in f 


By dx a Irov ay for all (x, y) in the domain of f. 


In other words, it doesn't matter in which order you take partial derivatives. This applies 
even to mixed partial derivatives of order 3 or higher. 
The notation for partial derivatives varies. All of the following are equivalent: 


ô 

se filx,y), filx,y), D.x,y), Dix, y) 

ô 

T, f(x,y), f(x,y), D,(x,y), D(x, y) 
af 
2 fa»), fux, y), D,(x,y), Dix, y) 
Ox 
8f 
E T4053, fs, y) , D (x,y), Dax, y) 
dy? 
8f 

: foxy), fiy), Dalx,y), DaGoy) 

y ðx 
aF 
fle), falx, y), Dy4G,»), Da(x,y) 
ÓxÓy 


2See pp. 214-216 in TAYLOR and MANN for a proof. 
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a Exercises 1-16, find or and a 
1. f(x, y) 2 x? + y? 2. f(x,y) 2 cos(x + y) 
3. f(x,y)= Vx? +y+4 4. f(x, y) = AFL 
ytl 

5. f(x, y)= e? +xy 6. f(x,y) 2 x? - y? - 6xy - Ax - 8y 2 
7. f(x, y) = x* 8. f(x,y) x^2y 
9. f(x,y) = vx? y? 10. f(x, y) 2 sin(x + y) 
11. f(x,y)= V x2 y +4 12. f(x,y) = et 

x+y 
13. f(x,y) = e € *»? 14. f(x, y) 2 In(xy) 
15. f(x,y)- sin(xy) 16. f(x,y) - tan(x + y) 
For Exercises 17-26, find ui rf and can (use Exercises 1-8, 14, 15). 
17. f(x,y)=x7 + y? 18. f(x,y) =cos(x + y) 
19. f(x,y)= Vx? +y¥+4 dü fugit 

y+1 
21. f(x,y) e? +xy 22. f(x,y) 2 x2 - y? - 6xy - Ax -8y - 2 
23. f(x, y) - x* 24. f(x, y) 2 x -2y 
25. f(x, y) 2 In(xy) 26. f(x,y) =sin(xy) 
B 
27. Show that the function f(x, y) = sin(x + y) 4 cos(x — y) satisfies the wave equation 

OR Ot 
ôx? Oy? 


The wave equation is an example of a partial differential equation. 


28. Let u and v be twice-differentiable functions of a single variable, and let c Z 0 be a con- 
stant. Show that f(x, y) = u(x cy) * v(x— cy) is a solution of the general one-dimensional 


wave equation? 
f 1f 


óx? c?0y) | 


3Conversely, it turns out that any solution must be of this form. See Ch. 1 in WEINBERGER. 
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2.3 Tangent Plane to a Surface 


In the previous section we mentioned that the partial derivatives ua and T can be thought 
of as the rate of change of a function z = f(x, y) in the positive x and y directions, respectively. 
Recall that the derivative gy of a function y = f(x) has a geometric meaning, namely as the 
slope of the tangent line to the graph of f at the point (x,f(«)) in R2. There is a similar 
geometric meaning to the partial derivatives we and of a function z = f(x,y): given a 
point (a,b) in the domain D of f(x, y), the trace of the surface described by z = f(x,y) in the 
plane y = b is a curve in R through the point (a, b, f (a, b)), and the slope of the tangent line 
L, to that curve at that point is oa, b). Similarly, La, b) is the slope of the tangent line 
L, to the trace of the surface z = f(x, y) in the plane x = a (see Figure 2.3.1). 


AZ AZ 


z=f(x,y) slope = a (a, b) 
A slope = 2 (a,b) E f(x,y) 
MA» a,b, f(a,b)) N 
i E D 
EM ^ EN rer f | 
0 0 
oUMS9o a ea ea 
EE ONE ra laaa AOD cat 
i D i D 
(a) Tangent line Ly in the plane y = b (b) Tangent line Ly in the plane x =a 


Figure 2.3.1 Partial derivatives as slopes 


Since the derivative 2 of a function y = f(x) is used to find the tangent line to the graph 
of f (which is a curve in R2), you might expect that partial derivatives can be used to define 
a tangent plane to the graph of a surface z = f(x,y). This indeed turns out to be the case. 
First, we need a definition of a tangent plane. The intuitive idea is that a tangent plane “just 
touches" a surface at a point. The formal definition mimics the intuitive notion of a tangent 
line to a curve. 


Definition 2.4. Let z = f(x, y) be the equation of a surface S in R, and let P = (a,b,c) be 
a point on S. Let T be a plane which contains the point P, and let Q = (x,y,z) represent a 


generic point on the surface S. If the (acute) angle between the vector PQ and the plane 
T approaches zero as the point Q approaches P along the surface S, then we call T' the 
tangent plane to S at P. 


Note that since two lines in R? determine a plane, then the two tangent lines to the surface 
z = f(x, y) in the x and y directions described in Figure 2.3.1 are contained in the tangent 
plane at that point, if the tangent plane exists at that point. The existence of those two 
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tangent lines does not by itself guarantee the existence of the tangent plane. It is possible 
that if we take the trace of the surface in the plane x — y = 0 (which makes a 45° angle with 
the positive x-axis), the resulting curve in that plane may have a tangent line which is not 
in the plane determined by the other two tangent lines, or it may not have a tangent line 
at all at that point. Luckily, it turns out^ that if or and or exist in a region around a point 
(a,b) and are continuous at (a,b) then the tangent plane to the surface z = f(x, y) will exist 
at the point (a,b, f (a, b)). In this text, those conditions will always hold. 


AZ 


Suppose that we want an equation of the tangent plane T 
to the surface z = f(x,y) at a point (a,b, f(a,b)). Let L, and 75 Fx, y) 
L, be the tangent lines to the traces of the surface in the 
planes y = b and x =a, respectively (as in Figure 2.3.2), and 
suppose that the conditions for T to exist do hold. Then the 
equation for T is 


ye 


A(x —a)+By—b)+C(z—f(a,b))=0 (2.4) 


x 


where n= (A,B,C) is a normal vector to the plane T. Since Figure 2.3.2 Tangent plane 


T contains the lines L, and L,, then all we need are vectors v, and v, that are parallel to L, 
and L,, respectively, and then let n = v, x v,. 


Since the slope of L, is 9f (a,b), then the vector v, = (1,0, 2. (a, b) is re 
x n v, + (1,0, £ (a, b) 
parallel to L, (since v, lies in the xz-plane and lies in a line with slope eara vo 


Lab) of . - 
i = 3, (a,b). See Figure 2.3.3). Similarly, the vector 


v, — (0,1, La, b)) is parallel to L,. Hence, the vector 


i j k 0 1 
n=v,xv,=|1 0 £(a,b) |=-L(a,b)i- La,b)j+k Figure 2.3.3 
of 
0 1 &Z(a,b) 


is normal to the plane T. Thus the equation of T is 
- SL(a,b)(x — a) - 2L (a, b)(y - b) - z - f(a,b) - 0. (2.5) 


Multiplying both sides by —1, we have the following result: 
The equation of the tangent plane to the surface z = f(x, y) at the point (a,b, f (a, b)) is 


Lla, b) (x - a) + SL(a, b) (y - b) - z f (a,b) - 0 (2.6) 


4See TAYLOR and MANN, $6.4. 
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Example 2.13. Find the equation of the tangent plane to the surface z = x? + y? at the point 
(1, 2,5). 

Solution: For the function f(x, y) = x? + y?, we have of - 2x and $f = 2y, so the equation of 
the tangent plane at the point (1, 2,5) is 


2(1)x - 1) + 2(2)(y-2)-z+5 =0, or 
2x+4y-—z-5=0. 
In a similar fashion, it can be shown that if a surface is defined implicitly by an equation 
of the form F(x, y,z) = 0, then the tangent plane to the surface at a point (a,b,c) is given by 


the equation 
Ac (a,b, c) (x — a) - F(a,b,c)(y—b)+ Fla,b,c)(z—c)=0. (2.7) 


Note that formula (2.6) is the special case of formula (2.7) where F(x, y,z)= f (x,y)- z. 
Example 2.14. Find the equation of the tangent plane to the surface x? + y? +z? = 9 at the 
point (2,2, —1). 


Solution: For the function F(x, y,z) = x? + y? - z2 - 9, we have 2E. oF = 2x, a = 2y, and oe = 2z, 
so the equation of the tangent plane at (2,2, — 1) is 


2(2)(x -2) + 2(2)(y - 27 2(-1)(z2 + 1) =0, or 
2x+2y—z-9=0. 


A 


For Exercises 1-6, find the equation of the tangent plane to the surface z = f(x,y) at the 
point P. 


1. f(x, y) 2 32 3, P  (1,1,2) 2. f(x, y) xy, P - (1,-1,-1) 
3. f(x,y)= xy, P 2 (-1,1,1) 4. f(x, y) » xe?, P 2 (1,0,1) 
5. f(x, y) - x -2y, P- (2,1,4) 6. f(x, y) - V x? + y2, P = (3,4,5) 


For Exercises 7-10, find the equation of the tangent plane to the given surface at the point 
P. 


Iu z= -LP- (1 2,241) 8. x? y? - 22 2 9, P = (0,0,3) 


7 
9. x24. y? - 22 0, P =(3,4,5) 10. x? +y? - 4, P- (/3,1,0) 
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2.4 Directional Derivatives and the Gradient 


For a function z = f(x,y), we learned that the partial derivatives af and £ represent the 
(instantaneous) rate of change of f in the positive x and y directions, respectively. What 
about other directions? It turns out that we can find the rate of change in any direction 
using a more general type of derivative called a directional derivative. 


Definition 2.5. Let f(x, y) be a real-valued function with domain D in R?, and let (a,b) be a 
point in D. Let v be a unit vector in R. Then the directional derivative of f at (a,b) in 
the direction of v, denoted by D,f (a,b), is defined as 


f(a,b)-- hv) - f (a, b) 


5 (2.8) 


D = Ih 
vf (a, b) lim 


Notice in the definition that we seem to be treating the point (a,b) as a vector, since we 
are adding the vector hv to it. But this is just the usual idea of identifying vectors with their 
terminal points, which the reader should be used to by now. If we were to write the vector v 
as v = (vı, V2), then 
f(a+hv,,b+hv)—f(a,b) 


7 (2.9) 


D,f(a,b)= lim 

h—0 

From this we can immediately recognize that the partial derivatives or and or are special 

cases of the directional derivative with v = i = (1,0) and v =j = (0,1), respectively. That is, 

ae = D;f and ue = D,f. Since there are many vectors with the same direction, we use a unit 
vector in the definition, as that represents a “standard” vector for a given direction. 

If f(x, y) has continuous partial derivatives of and or (which will always be the case in 

this text), then there is a simple formula for the directional derivative: 


Theorem 2.2. Let f(x,y) be a real-valued function with domain D in R? such that the 
partial derivatives = and sf exist and are continuous in D. Let (a,b) be a point in D, and 


let v = (v,,v;) be a unit vector in R2. Then 


D,f(a,b)= WG SEDE (2.10) 
Ox Oy 


Proof: Note that if v = i = (1,0) then the above formula reduces to D,f(a,b) = of (a,b), 
which we know is true since D;f = 7, as we noted earlier. Similarly, for v = j = (0,1) the 
formula reduces to D,f (a,b) — 2 (a, b), which is true since D;f = a. So since i — (1,0) and 
j - (0,1) are the only unit vectors in R? with a zero component, then we need only show the 


formula holds for unit vectors v = (v,,v,) with v, Z 0 and v, Z 0. So fix such a vector v and 
fix a number 7 #0. 
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Then 


79 


f(a* hv,b * hv) - fla,b)= f (a hv, b c hv;) - f(a * hv, b) * f(a * hvi, b) - f (a,b) . (2.11) 


Since h Z 0 and v, Z 0, then hv, 4 0 and thus any number c between b and b+ hv, can be 
written as c = b+ ahv, for some number 0 < a < 1. So since the function f(a+hv,, y) is a real- 
valued function of y (since a + hv, is a fixed number), then the Mean Value Theorem from 
single-variable calculus can be applied to the function g(y) = f (a + hv, y) on the interval 
[b,b + hvo] (or [b + hvs, b] if one of h or v; is negative) to find a number 0 < a < 1 such that 


af E _ g(b+hv,)—g(b) f(a-*hv,b-* hv) - f(a + hv,,b) 
35 usb pane g (b + ahv») = b+hu,-b hv; 
and so 


ô 
flathv,,b+hv.)—-flathv,,b) = hv (a + hv, b + ahv). 
y 
By a similar argument, there exists a number 0 « f « 1 such that 
of 
f(a-- hv, b) - f(a,b) = hv, 3c (a + hvi b). 
Thus, by equation (2.11), we have 


f(a-* hv,,b - hv,) - f (a,b) hv. SL (a +hu,,6+ ahv) + hv: DL (a + Bhvi, b) 
h h 


ô Ó 
= ú Lia + hv, b +ahv,)+ DU + Bhv,, b) 
Oy Ox 


so by formula (2.9) we have 


f(at+hu,,6+ hv,)— f (a,b) 
fe eGR Be, 


D = ]i 
vf (a,b) lim A 
: ô ô 
= Im v Lla hos, b-- ah) ev. (a + Phvs,b) 
Ó ô ô ô 
= a d ad by the continuity maai and zs so 
oy Ox Ox Oy 
ô ô 
D,f(a,b) = n ERU a 
Ox Oy 


after reversing the order of summation. 


Note that D,f (a,b) - v. (2a, b), a (a, b). The second vector has a special name: 


QED 
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Definition 2.6. For a real-valued function f (x, y), the gradient of f, denoted by Vf, is the 
vector 


(2.12) 


in R2. For a real-valued function f(x,y,z), the gradient is the vector 


of of Of 


wol 


in R?. The symbol V is pronounced “del”.5 


Example 2.15. Find the directional derivative of f(x, y) = xy? + x? y at the point (1,2) in the 
i i -(L L 

direction of v = (+ 4). 

Solution: We see that Vf = (y? + 3x? y, 2xy + x?), so 


D,f(1,2) = v-VfQ,2) = ( 2 +302), 20+) 2 72 


1 1 
A 


A real-valued function z = f(x, y) whose partial derivatives ae and ue exist and are con- 
tinuous is called continuously differentiable. Assume that f (x, y) is such a function and that 
Vf #0. Let c be a real number in the range of f and let v be a unit vector in R? which is 
tangent to the level curve f(x, y) 7» c (see Figure 2.4.1). 


fy ov Vf 


f(x, y)- c 


TR 


ZN 
S 


Figure 2.4.1 


5Sometimes the notation grad(f) is used instead of Vf. 
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The value of f(x,y) is constant along a level curve, so since v is a tangent vector to this 
curve, then the rate of change of f in the direction of v is 0, i.e. D,f = 0. But we know that 
D,f =v- Vf = |vI I Vf l| cos0, where 0 is the angle between v and Vf. So since ||v|| = 1 then 
D,f -|Vf || cos0. So since Vf 4 0 then D,f = 0 > cos0-0— 0 = 90°. In other words, Vf L v, 
which means that Vf is normal to the level curve. 

In general, for any unit vector v in R2, we still have D,f = || Vf || cos0, where 0 is the angle 
between v and V/. At a fixed point (x, y) the length || Vf || is fixed, and the value of D,f then 
varies as 0 varies. The largest value that D,f can take is when cos0 = 1 (0 = 0°), while the 
smallest value occurs when cos@ = -1 (0 = 180°). In other words, the value of the function 
f increases the fastest in the direction of Vf (since 0 = 0° in that case), and the value of 
f decreases the fastest in the direction of —Vf (since 0 = 180° in that case). We have thus 
proved the following theorem: 


Theorem 2.4. Let f(x, y) be a continuously differentiable real-valued function, with Vf # 0. 
Then: 


(a) The gradient Vf is normal to any level curve f(x, y)=c. 


(b) The value of f(x, y) increases the fastest in the direction of Vf. 


(c) The value of f(x, y) decreases the fastest in the direction of —Vf. 


Example 2.16. In which direction does the function f(x, y) = xy? + x?y increase the fastest 
from the point (1,2)? In which direction does it decrease the fastest? 


Solution: Since Vf = (y? + 3x? y,2xy +x3), then Vf (1,2) = (10,5) 4 0. A unit vector in that 

direction is v — wA = (=. +). Thus, f increases the fastest in the direction of (=. LJ and 
: : s = af 

decreases the fastest in the direction of (2, 4). 

Though we proved Theorem 2.4 for functions of two variables, a similar argument can 
be used to show that it also applies to functions of three or more variables. Likewise, the 
directional derivative in the three-dimensional case can also be defined by the formula D,f = 
v: Vf. 


Example 2.17. The temperature T of a solid is given by the function T(x,y,z) 2 e * +e7” + 
e* , where x, y, z are space coordinates relative to the center of the solid. In which direction 
from the point (1, 1, 1) will the temperature decrease the fastest? 

Solution: Since Vf = (-e^*,—2e-?", 4e*?), then the temperature will decrease the fastest in 
the direction of -Vf(1,1,1)— (e71, 38-4 —4e*), 
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A 
For Exercises 1-10, compute the gradient Vf. 
1 
Lear E 
1. f(x, y)=x" +y" —1 2. aT 
3. f(x, y)= Vx? - y? +4 4. f(x,y) 2 x?e? 
5. f(x,y) 2In(xy) 6. f(x,y) 2x ^ 5y 
7. f(x,y,2)7 sin(xyz) 8. f(x,y,z) = x?e?? 
9. f(x, y,z) 2 x? + y? +2? 10. f(x,y,z) - y x? + y? + z? 
For Exercises 11-14, find the directional derivative of f at the point P in the direction of 
=-(L d 
aM (> Ji 
1 

11. f(x,y) 2x? ? -1, P- (1,1) 12. f(x, y) 2 5—S, P=(1,1) 

x2 + y? 
13. f(x,y) Vx? + y? - 4, P=(1,1) 14. f(x,y) = xe, PSH 


For Exercises 15-16, find the directional derivative of f at the point P in the direction of 
v= (4. 4 +, 
V3? V3’ V3)" 
15. f(x, y,z)=sin(xyz), P =(1,1,1) 16. f (x,y,z) 2 x?e??, P =(1,1,1) 
17. Repeat Example 2.16 at the point (2,3). 
18. Repeat Example 2.1" at the point (3, 1,2). 


B 


For Exercises 19-26, let f(x,y) and g(x,y) be continuously differentiable real-valued func- 
tions, let c be a constant, and let v be a unit vector in R2. Show that: 


19. V(cf) - cVf 20. Vf -g) - Vf ^ Vg 

21. Vf - f Va «g vf 22. vifig)= SES it g(x,y) 40 
23. Df - -D,f 24. Di(cf)=cDyf 

25. Df ^ g)- D,f + Dyg 26. D(fg)- f D,g + gD.f 


27. The function r(x, y) = x? y? is the length of the position vector r = xi+ yj for each 
point (x, y) in R2. Show that Vr = —r when (x, y) Z (0,0), and that V(r?) = 2r. 
r 
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2.5 Maxima and Minima 


The gradient can be used to find extreme points of real-valued functions of several variables, 
that is, points where the function has a local maximum or local minimum. We will consider 
only functions of two variables; functions of three or more variables require methods using 
linear algebra. 


Definition 2.7. Let f(x, y) be a real-valued function, and let (a,b) be a point in the domain 
of f. We say that f has a local maximum at (a,b) if f (x, y) x f (a,b) for all (x, y) inside some 
disk of positive radius centered at (a,b), i.e. there is some sufficiently small r > 0 such that 
f(x,y) < f (a, b) for all (x, y) for which (x - a? + (y - b « r?. 


Likewise, we say that f has a local minimum at (a,b) if f(x, y) = f (a,b) for all (x, y) 
inside some disk of positive radius centered at (a,b). 

If f(x,y) s f (a,b) for all (x, y) in the domain of f, then f has a global maximum at 
(a,b). If f (x, y) = f (a, b) for all (x, y) in the domain of f, then f has a global minimum at 
(a, b). 


Suppose that (a,b) is a local maximum point for f(x, y), and that the first-order partial 
derivatives of f exist at (a,b). We know that f (a,b) is the largest value of f(x, y) as (x, y) 
goes in all directions from the point (a,b), in some sufficiently small disk centered at (a,b). 
In particular, f (a,b) is the largest value of f in the x direction (around the point (a, 5)), that 
is, the single-variable function g(x) = f(x, b) has a local maximum at x =a. So we know that 
&'(a) 2 0. Since g'(x) = of (x, b), then of (a,b) =0. Similarly, f (a,b) is the largest value of f 


near (a,b) in the y direction and so aL (a, b) 2 0. We thus have the following theorem: 


Theorem 2.5. Let f (x, y) be a real-valued function such that both He b) and La, b) exist. 


Then a necessary condition for f(x,y) to have a local maximum or minimum at (a,b) is that 
Vf (a,b) — 0. 


Note: Theorem 2.5 can be extended to apply to functions of three or more variables. 

A point (a,b) where Vf (a, b) =0 is called a critical point for the function f(x, y). So given 
a function f(x, y), to find the critical points of f you have to solve the equations Ex, y)=0 
and L(x, y) = 0 simultaneously for (x, y). Similar to the single-variable case, the necessary 
condition that V/f(a,b)=0 is not always sufficient to guarantee that a critical point is a local 
maximum or minimum. 


Example 2.18. The function f (x, y) 2 xy has a critical point at (0,0): or =y=0> y=0, and 
sf =x =0 > x= 0, so (0,0) is the only critical point. But clearly f does not have a local 
maximum or minimum at (0,0) since any disk around (0,0) contains points (x, y) where the 
values of x and y have the same sign (so that f(x, y) 2 xy > 0 = f(0,0)) and different signs (so 


that f(x, y) 2 xy < 0 = f(0,0)). In fact, along the path y = x in R2, f(x, y) 2 x?, which has a 
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local minimum at (0,0), while along the path y = —x we have f(x, y) = —x?, which has a local 
maximum at (0,0). So (0,0) is an example of a saddle point, i.e. it is a local maximum in one 
direction and a local minimum in another direction. The graph of f(x, y) is shown in Figure 
2.5.1, which is a hyperbolic paraboloid. 


100 - 
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a ee 
0 
z 
-50 
-10 
-1001 " 


Figure 2.5.1 /(x,y)- xy, saddle point at (0,0) 


The following theorem gives sufficient conditions for a critical point to be a local maximum 
or minimum of a smooth function (i.e. a function whose partial derivatives of all orders exist 
and are continuous), which we will not prove here.’ 


Theorem 2.6. Let f(x,y) be a smooth real-valued function, with a critical point at (a, b) (i.e. 
Vf (a,b) 2 0). Define 


oF of Ef 
z707- 


D= (a,b) 


Ox? Oy Ox 


Then 


(a) if D » 0 and Me. b)>0, then f has a local minimum at (a,b) 


(b) if D » 0 and 2d b) <0, then f has a local maximum at (a, b) 


(c) if D <0, then f has neither a local minimum nor a local maximum at (a,b) 


(d) if D =0, then the test fails. 


6See TAYLOR and MANN, $ 7.6. 
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If condition (c) holds, then (a, b) is a saddle point. Note that the assumption that f(x, y) is 
smooth means that 


af arf 
T a2 09 aya (a,b) 
[o af 
Gray) gL 


2 2 2 2 2 2 2 
since ££ = ZL. Also, if D > 0 then S(a,b)Sh(a,b)=D +(F£(a,b)) » 0, and so $a, 6) 
and P, b) have the same sign. This means that in parts (a) and (b) of the theorem one 


can replace 2 td: b) by P (a. b) if desired. 


Ox? 


Example 2.19. Find all local maxima and minima of f(x, y) = x? + xy + y? — 3x. 


Solution: First find the critical points, i.e. where Vf = 0. Since 
ô ô 
OE rere and oF ptos 
Ox Oy 


then the critical points (x, y) are the common solutions of the equations 


2x+ y-38=0 
x+2y =0 


which has the unique solution (x, y) = (2,—1). So (2, — 1) is the only critical point. 
To use Theorem 2.6, we need the second-order partial derivatives: 


ET aa GT sy EE 
ax? ^" Oy) "' Ay Ox 
and so 5 3 3 " 
o"f orf ô f 2 
D = —(2,-D—5G,-1- 2,0) = 202-12 = 385 0 
ae Dae D lya) = e» > 


and 2, —1)=2>0. Thus, (2, - 1) is a local minimum. 
Example 2.20. Find all local maxima and minima of f(x, y) = xy- x? — y?. 


Solution: First find the critical points, i.e. where Vf = 0. Since 


ð 0 
ee and OF abes 
Ox Oy 
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then the critical points (x, y) are the common solutions of the equations 


y — 3x7 =0 
x-2y=0 


The first equation yields y = 3x”, substituting that into the second ealon yields x—6x? = 0, 
which has the solutions x = 0 and x = 4. Sox -02 y 2 30-0 and x - $— y - 8(d y- i. 
So the critical points are (x, y) = (0,0) and (x,y)- (4, i). 

To use Theorem 2.6, we need the second-order partial derivatives: 


2 2 2 
a ERE 9 sedi OF 


Ox? |— ' Ay2 ° Óyóx 


So 
i H 2f 


ð 
Dx 0i 


;(0,0)- (x (0,0) = (-6(0)(-2)-1? = -1« 0 


and thus (0,0) is a saddle m Also, 


2 Pd PLE ira y) = = (-6(= zc 2)-17 =1>0 


0x2 6 12) 3216 12) “By aq 6? 12 
2 
and (i. i)--1«0. Thus, (4.45) is a local maximum. 


Example 2.21. Find all local maxima and minima of f(x, y) = (x - 2)* + (x —2y)?. 
Solution: First find the critical points, i.e. where Vf = 0. Since 
ô ô 
CET + (x —2y) and ar = —4(x- 2y) 
Ox Oy 


then the critical points (x, y) are the common solutions of the equations 


4(x — 2)? + 2(x -2y) 20 
-4(x—-2y)20 
The second equation yields x = 2y, substituting that into the first equation yields 4(2y - 2)? = 


0, which has the solution y = 1, and so x = 2(1) = 2. Thus, (2,1) is the only critical point. 
To use Theorem 2.6, we need the second-order partial derivatives: 


0? 2 2 
ô ô 
OF opua. a DRE 
Ox? 0y? dy dx 
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So 
ET PE arf 2 2 
D = — (2, 1)— (2, 1)- | —— (2, 1)]_ = 2Y8-(-4 = 0 
a5 0 550 D-[Le,5) = exe-co 
and so the test fails. What can be done in this situation? Sometimes it is possible to examine 
the function to see directly the nature of a critical point. In our case, we see that f(x, y) 2 0 
for all (x, y), since f'(x, y) is the sum of fourth and second powers of numbers and hence must 
be nonnegative. But we also see that f (2,1) 2 0. Thus f(x, y) 2 0 = f (2,1) for all (x, y), and 


hence (2, 1) is in fact a global minimum for f. 


Example 2.22. Find all local maxima and minima of f(x, y) = (x? + yje ty m 


Solution: First find the critical points, i.e. where Vf = 0. Since 


ô 

Of = 2x(1- (x? + ye +9”) 
Ox 

ô 

af = Qy(1—(x2 + y3e € *»? 
dy 


then the critical points are (0,0) and all points (x, y) on the unit circle x? + y? = 1. 
To use Theorem 2.6, we need the second-order partial derivatives: 


à? 
ai = 2[1- (x? + y?) 2x? - 2320 - (x? + ye" 
af 2,,2 2 2 2 243,57 G2 y?) 
ET = 2[1- (x^ + y?) - 2y* - 2y" (1. - (x^ + y?)e 
of 2 2y,- G3?) 
= —A4xy[2 - (x^  y*)]e y 
ðyðx 


At (0,0), we have D = 4 > 0 and ŽE (0,0) = 2 > 0, so (0,0) is a local minimum. However, for 
points (x, y) on the unit circle x? + y? = 1, we have 


D = (-Ax?e (-Ayle !)- (-Axye | = 0 


and so the test fails. If we look at the graph of f (x, y), as shown in Figure 2.5.2, it looks like 
we might have a local maximum for (x, y) on the unit circle x? + y? = 1. If we switch to using 
polar coordinates (r,0) instead of (x, y) in R2, where r? = x?4- y, then we see that we can write 
f(x,y) as a function g(r) of the variable r alone: g(r) = r2e-". Then g'(r) - 2r(1- rye", 
so it has a critical point at r = 1, and we can check that g"(1) = —4e^! < 0, so the Second 
Derivative Test from single-variable calculus says that r = 1 is a local maximum. But r=1 
corresponds to the unit circle x? + y? = 1. Thus, the points (x, y) on the unit circle x? + y? = 1 
are local maximum points for f. 
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Figure 2.5.2 f(x,y) =(x?+ pre t) 


sd Exercises 1-10, find all local maxima and minima of the function f(x, y). 

1. f(x, y) = x? - 3x y? 2. f(x,y) = x3 - 12x + y? + 8y 

3. f(x, y) 2 x? - 3x - y? - 8y 4. f(x, y) 2 x9 + 3x? + y’ -3y 

5. f(x, y) = 2x? - 6xy - 35? 6. f(x, y) 2 2x? -6xy + y? 

7. f(y) = Vat ey? 8. fG,y) - x 2y 

9. f(x, y) - Ax? - Axy + 2y? + 10x — 6y 10. f(x,y) 2 -4x? + Axy - 2y? + 16x - 12y 
B 


11. For a rectangular solid of volume 1000 cubic meters, find the dimensions that will min- 
imize the surface area. (Hint: Use the volume condition to write the surface area as a 
function of just two variables.) 


12. Prove that if (a,b) is a local maximum or local minimum point for a smooth function 
f (x, y), then the tangent plane to the surface z = f(x, y) at the point (a,b, f (a, b)) is parallel 
to the xy-plane. (Hint: Use Theorem 2.5.) 


C 


13. Find three positive numbers x, y, z whose sum is 10 such that x?y?z is a maximum. 
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2.6 Unconstrained Optimization: Numerical Methods 


The types of problems that we solved in the previous section were examples of unconstrained 
optimization problems. That is, we tried to find local (and perhaps even global) maximum 
and minimum points of real-valued functions f(x,y), where the points (x, y) could be any 
points in the domain of f. The method we used required us to find the critical points of f, 
which meant having to solve the equation Vf = 0, which in general is a system of two equa- 
tions in two unknowns (x and y). While this was relatively simple for the examples we did, 
in general this will not be the case. If the equations involve polynomials in x and y of degree 
three or higher, or complicated expressions involving trigonometric, exponential, or loga- 
rithmic functions, then solving even one such equation, let alone two, could be impossible by 
elementary means." 
For example, if one of the equations that had to be solved was 


x?-9x-2-20, 


you may have a hard time getting the exact solutions. Trial and error would not help much, 
especially since the only real solution? turns out to be V V28+1- V V/28 - 1. In a situation 
such as this, the only choice may be to find a solution using some numerical method which 
gives a sequence of numbers which converge to the actual solution. For example, Newton's 
method for solving equations f(x) = 0, which you probably learned in single-variable calcu- 
lus. In this section we will describe another method of Newton for finding critical points of 
real-valued functions of two variables. 
Let f(x,y) be a smooth real-valued function, and define 


0?f 8f ( af 


2 


Newton’s algorithm: Pick an initial point (x,, Yo). For n 2 0,1,2,3,..., define: 


à? "n " " 
S (an In) ds (on Yn) TE (x Ya) SE (ns In) 
ô ô ô ô 
NE Gy) Eleny) eC E E 
nl n D(x,,y,) > Yn+1 Yn D(x,, Yn) * 
oo 


Then the sequence of points (x,,y,)7 , converges to a critical point. If there are several 
critical points, then you will have to try different initial points to find them. 


7This is also a problem for the equivalent method (the Second Derivative Test) in single-variable calculus, 
though one that is not usually emphasized. 

8There are also two nonreal, complex number solutions. Cubic polynomial equations in one variable can be 
solved using Cardan's formulas, which are not quite as simple as the familiar quadratic formula. See USPENSKY 
for more details. There are formulas for solving polynomial equations of degree 4, but it can be proved that there 
is no general formula for solving equations for polynomials of degree five or higher. 
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Example 2.23. Find all local maxima and minima of f(x, y) = x? - xy - x + xy? — y4. 


Solution: First calculate the necessary partial derivatives: 


[7 ô 

SE EE Uf ee dy 

Ox Oy 
o? o? o? 
OF Ge, P iiy- ia, f =-1+3y" 
Ox? 0y? Oy 0x 


Notice that solving Vf = 0 would involve solving two third-degree polynomial equations in x 
and y, which in this case can not be done easily. 

We need to pick an initial point (xo, yo) for our algorithm. Looking at the graph of z = f(x, y) 
over a large region may help (see Figure 2.6.1 below), though it may be hard to tell where 
the critical points are. 


50000 
0 
-50000 
-100000 
-150000 
-200000 
-250000 
-300000 

-350000, 


20 20 


Figure 2.6. f(x,y)= x3 xy x4 xy) yt for -20 x x 20 and -20 < y < 20 


Notice in the formulas (2.14) that we divide by D, so we should pick an initial point where 
D is not zero. And we can see that D(0,0) = (00) (-1)? = —1 # 0, so take (0,0) as our initial 
point. Since it may take a large number of iterations of Newton's algorithm to be sure that 
we are close enough to the actual critical point, and since the computations are quite tedious, 
we will let a computer do the computing. For this, we will write a simple program, using 
the Java programming language, which will take a given initial point as a parameter and 
then perform 100 iterations of Newton's algorithm. In each iteration the new point will be 
printed, so that we can see if there is convergence. The full code is shown in Listing 2.1. 


2.6 Unconstrained Optimization: Numerical Methods 


//Program to find the critical points of f(x,y)ex^3-xy-x*xy^3-y^4 
public class newton { 
public static void main(String[] args) { 
//Get the initial point (x,y) as command-line parameters 
double x = Double.parseDouble(args[0]); //Initial x value 
double y = Double.parseDouble(args[1]); //Initial y value 
System.out.println("Initial point: ("+x * "," +y * ")"); 
//Go through 100 iterations of Newton's algorithm 
for (int n=1; n<=100; n++) { 
double D = fxx(x,y)*fyy(x,y) - Math.pow(fxy(x,y),2); 
double xn = x; double yn = y; //The current x and y values 
if (D == 0) ( //We can not divide by 0 
System.out.println("Error: D = 0 at iteration n = " + n); 
System.exit(0); //End the program 
} else { //Calculate the new values for x and y 
x = xn - (fyy(xn,yn)*fx(xn,yn) - fxy(xn,yn)*fy(xn,yn))/D; 
y = yn - (fxx(xn,yn)*fy(xn,yn) - fxy(xn,yn)*fx(xn,yn))/D; 
System: out; prn; n Sm = om r ee pp py 


//Below are the parts specific to the function f 
//The first partial derivative of f wrt x: 3x^2-y-1*y^3 
public static double fx(double x, double y) { 
return 3«Math.pow(x,2) - y - 1 + Math.pow(y,3) ; 
I 
//The first partial derivative of f wrt y: -x+3xy^2-4y^3 
public static double fy(double x, double y) { 
return -x + 3*x*Math.pow(y,2) - 4*Math.pow(y,3); 
} 
//The second partial derivative of f wrt x: 6x 
public static double fxx(double x, double y) { 
return 6+*x; 
} 
//The second partial derivative of f wrt y: 6xy-12y^2 
public static double fyy(double x, double y) { 
return 6*x*y - 12*Math.pow(y,2); 
} 
//The mixed second partial derivative of f wrt x and y: -1+3y^2 
public static double fxy(double x, double y) { 
return -1 + 3*Math.pow(y,2); 


Listing 2.1 Program listing for newton.java 
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To use this program, you should first save the code in Listing 2.1 in a plain text file called 
newton. java. You will need the Java Development Kit? to compile the code. In the directory 
where newton. java is saved, run this command at a command prompt to compile the code: 
javac newton.java 
Then run the program with the initial point (0,0) with this command: 
java newton 0 0 

Below is the output of the program using (0,0) as the initial point, truncated to show the 
first 10 lines and the last 5 lines: 


java newton 0 0 
Initial point: (0.0,0.0) 


n= 1: (0.0,-1.0) 

n= 2: (1.0,-0.5) 

n = 3: (0.6065857885615251, -0.44194107452339687) 
n = 4: (0.484506572966545, -0.405341511995805) 

n = 5: (0.47123972682634485, -0.3966334583092305) 
n = 6: (0.47113558510349535, -0.39636450001936047) 
n = 7: (0.4711356343449705, -0.3963643379632247) 

n = 8: (0.4711356343449874, -0.39636433796318005) 
n = 9: (0.4711356343449874, -0.39636433796318005) 
n = 10: (0.4711356343449874, -0.39636433796318005) 
n = 96: (0.4711356343449874, -0.39636433796318005) 
n = 97: (0.4711356343449874, -0.39636433796318005) 
n = 98: (0.4711356343449874, -0.39636433796318005) 
n = 99: (0.4711356343449874, -0.39636433796318005) 
n = 100: (0.4711356343449874, -0.39636433796318005) 


As you can see, we appear to have converged fairly quickly (after only 8 iterations) to 
what appears to be an actual critical point (up to Java's level of precision), namely the point 
(0.4711356343449874, —0.39636433796318005). It is easy to confirm that Vf = 0 at this 
point, either by evaluating or and or at the point ourselves or by modifying our program to 
also print the values of the partial derivatives at the point. It turns out that both partial 
derivatives are indeed close enough to zero to be considered zero: 


0 
SF (0.4711356343449874, —0.39636433796318005) = 4.85722573273506 x 10717 
x 
0 
I-(0.4711956349449874, —0.39636433796318005) = —8.326672684688674 x 10 7 
J. 


We also have D(0.4711356343449874, —0.39636433796318005) = —8.776075636032301 < 0, 
so by Theorem 2.6 we know that (0.4711356343449874, -0.8396364337963 18005) is a saddle 
point. 


9 Available for free at http://www.oracle.com/technetwork/java/javase/downloads/ 
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Since Vf consists of cubic polynomials, it seems likely that there may be three critical 
points. The computer program makes experimenting with other initial points easy, and 
trying different values does indeed lead to different sequences which converge: 


java newton -1 -1 
Initial point: (-1.0,-1.0) 


n= 1: (-0.5,-0.5) 

n = 2: (-0.49295774647887325, -0.08450704225352113) 
n = 3: (-0.1855674752461383, -1.2047647348546167) 
n = 4: (-0.4540060574531383, -0.8643989895639324) 
n = 5: (-0.3672160534444, -0.5426077421319053) 

n = 6: (-0.4794622222856417, -0.24529117721011612) 
n = 7: (0.11570743992954591, -2.4319791238981274) 
n = 8: (-0.05837851765533317, -1.6536079835854451) 
n = 9: (-0.129841298650007, -1.121516233310142) 

n = 10: (-1.004453014967208, -0.9206128022529645) 
n = 11: (-0.5161209914612475, -0.4176293491131443) 
n = 12: (-0.5788664043863884,0.2918236503332734) 
n 13: (-0.6985177124230715,0.49848120123515316) 
n 14: (-0.6733618916578702,0.4345777963475479) 
n 15: (-0.6704392913413444,0.4252025996474051) 
n 16: (-0.6703832679150286,0.4250147307973365) 
n 17: (-0.6703832459238701,0.42501465652421205) 
n = 18: (-0.6703832459238667,0.4250146565242004) 
n = 19: (-0.6703832459238667,0.42501465652420045) 
n = 20: (-0.6703832459238667,0.42501465652420045) 
n = 98: (-0.6703832459238667,0.42501465652420045) 
n = 99: (-0.6703832459238667,0.42501465652420045) 
n - 100: (-0.6703832459238667,0.42501465652420045) 


Again, it is easy to confirm that both or and of vanish at the point 
(—0.6703832459238667,0.42501465652420045), which means it is a critical point. And 


D(—0.6703832459238667, 0.42501465652420045) = 15.3853578526055 > 0 


2 0.6703832459238667,0.42501465652420045) = —4.0222994755432 « 0 
so we Ls that (—0.6703832459238667,0.42501465652420045) is a local maximum. An 
idea of what the graph of f looks like near that point is shown in Figure 2.6.2, which does 
suggest a local maximum around that point. 
Finally, running the computer program with the initial point (—5, —5) yields the critical 
point (—7.540962756992551, —5.595509445899435), with D « 0 at that point, which makes 
it a saddle point. 
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Figure2.6.2 f(xyy)-x?-xy-x-xy)?-y*for-1zxz0and0zyz1 


We can summarize our findings for the function f(x, y) = x? - xy ^ x + xy? — yt: 


(0.4711356343449874, —0.39636433796318005): saddle point 
(—0.6703832459238667, 0.42501465652420045): local maximum 
(—7.540962756992551, —5.595509445899435) : saddle point 


The derivation of Newton's algorithm, and the proof that it converges (given a “reason- 
able" choice for the initial point) requires techniques beyond the scope of this text. See 
RALSTON and RABINOWITZ for more detail and for discussion of other numerical methods. 
Our description of Newton's algorithm is the special two-variable case of a more general 
algorithm that can be applied to functions of n = 2 variables. 

In the case of functions which have a global maximum or minimum, Newton's algorithm 
can be used to find those points. In general, global maxima and minima tend to be more 
interesting than local versions, at least in practical applications. À maximization problem 
can always be turned into a minimization problem (why?), so a large number of methods 
have been developed to find the global minimum of functions of any number of variables. 
This field of study is called nonlinear programming. Many of these methods are based on the 
steepest descent technique, which is based on an idea that we discussed in Section 2.4. Recall 
that the negative gradient —Vf gives the direction of the fastest rate of decrease of a function 
f. The crux of the steepest descent idea, then, is that starting from some initial point, you 
move a certain amount in the direction of -Vf at that point. Wherever that takes you 
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becomes your new point, and you then just keep repeating that procedure until eventually 
(hopefully) you reach the point where f has its smallest value. There is a “pure” steepest 
descent method, and a multitude of variations on it that improve the rate of convergence, 
ease of calculation, etc. In fact, Newton's algorithm can be interpreted as a modified steepest 
descent method. For more discussion of this, and of nonlinear programming in general, see 
BAZARAA, SHERALI and SHETTY. 


C 


1. Recall Example 2.21 from the previous section, where we showed that the point (2, 1) was 
a global minimum for the function f(x, y) = (x — 2)* + (x — 2y). Notice that our computer 
program can be modified fairly easily to use this function (just change the return values 
in the fx, fy, fxx, fyy and fxy function definitions to use the appropriate partial derivative). 
Either modify that program or write one of your own in a programming language of your 
choice to show that Newton’s algorithm does lead to the point (2,1). First use the initial 
point (0,3), then use the initial point (3,2), and compare the results. Make sure that your 
program attempts to do 100 iterations of the algorithm. Did anything strange happen 
when your program ran? If so, how do you explain it? (Hint: Something strange should 
happen.) 


2. There is a version of Newton's algorithm for solving a system of two equations 
filx,y)=0 and  fix,y-0, 


where f(x, y) and f,(x, y) are smooth real-valued functions: 
Pick an initial point (xo, yo). For n = 0,1,2,3,..., define: 


fix, Yn) fix. Vn) fix, Yn) f(x, Yn) 


ô ô 
pe P(x, yn) AP s, Yn) E Sf sy.) o sy) hne 
n+1 =. n D(x,, Yn) ? Yna = Yn D(x,,y,) > 
of, of, of, of, 


D = ane apie 2 A 
(ys) ax (Xn, Yn) ay (Xn, Yn) By (Xn, Yn) 3 (x, Yn) 


Then the sequence of points (x,, y,)7? , converges to a solution. Write a computer program 


that uses this algorithm to find approximate solutions to the system of equations 
fix, y) = sinxy)- x—-y =0 and fx, y) =e% —2x43y 20. 


Show that you get two different solutions when using (0,0) and (1, 1) for the initial point 
(Xo, yo). 
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2.7 Constrained Optimization: Lagrange Multipliers 


In Sections 2.5 and 2.6 we were concerned with finding maxima and minima of functions 
without any constraints on the variables (other than being in the domain of the function). 
What would we do if there were constraints on the variables? The following example illus- 
trates a simple case of this type of problem. 


Example 2.24. For a rectangle whose perimeter is 20 m, find the dimensions that will max- 
imize the area. 


Solution: The area A of a rectangle with width x and height y is A = xy. The perimeter P of 
the rectangle is then given by the formula P = 2x+2y. Since we are given that the perimeter 
P = 20, this problem can be stated as: 


Maximize: f(x,y) 2 xy 
given: 2x * 2y = 20 


The reader is probably familiar with a simple method, using single-variable calculus, for 
solving this problem. Since we must have 2x+2y = 20, then we can solve for, say, y in 
terms of x using that equation. This gives y = 10— x, which we then substitute into f to get 
f(x, y) = xy = x(10—x) = 10x — x?. This is now a function of x alone, so we now just have to 
maximize the function f(x) = 10x — x? on the interval [0,10]. Since f(x) = 10-2x 20 x -5 
and f "(5) = —2 < 0, then the Second Derivative Test tells us that x = 5 is a local maximum 
for f, and hence x = 5 must be the global maximum on the interval [0,10] (since f = 0 at 
the endpoints of the interval). So since y = 10— x = 5, then the maximum area occurs for a 
rectangle whose width and height both are 5 m. 


Notice in the above example that the ease of the solution depended on being able to solve 
for one variable in terms of the other in the equation 2x + 2y = 20. But what if that were not 
possible (which is often the case)? In this section we will use a general method, called the 
Lagrange multiplier method", for solving constrained optimization problems: 


Maximize (or minimize): f(x,y) (or f(x,y,z)) 


given: g(x,y)=c (or g(x,y,z) 2 c) for some constant c 


The equation g(x,y) = c is called the constraint equation, and we say that x and y are con- 
strained by g(x,y) = c. Points (x, y) which are maxima or minima of f(x,y) with the con- 
dition that they satisfy the constraint equation g(x, y) = c are called constrained maximum 
or constrained minimum points, respectively. Similar definitions hold for functions of three 
variables. 

The Lagrange multiplier method for solving such problems can now be stated: 


10Named after the French mathematician Joseph Louis Lagrange (1736-1813). 
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Theorem 2.7. Let f(x, y) and g(x,y) be smooth functions, and suppose that c is a scalar 
constant such that Vg(x,y) 4 0 for all (x, y) that satisfy the equation g(x,y) = c. Then to 
solve the constrained optimization problem 


Maximize (or minimize): f(x,y) 


given: g(x,y)- c, 


find the points (x, y) that solve the equation Vf'(x, y) = AVg(x, y) for some constant A (the 
number 4 is called the Lagrange multiplier). If there is a constrained maximum or mini- 
mum, then it must be such a point. 


A rigorous proof of the above theorem requires use of the Implicit Function Theorem, 
which is beyond the scope of this text.!! Note that the theorem only gives a necessary con- 
dition for a point to be a constrained maximum or minimum. Whether a point (x, y) that 
satisfies Vf (x, y) = AVg(x, y) for some A actually is a constrained maximum or minimum can 
sometimes be determined by the nature of the problem itself. For instance, in Example 2.24 
it was clear that there had to be a global maximum. 

So how can you tell when a point that satisfies the condition in Theorem 2.7 really is a 
constrained maximum or minimum? The answer is that it depends on the constraint func- 
tion g(x,y), together with any implicit constraints. It can be shown!’ that if the constraint 
equation g(x,y) = c (plus any hidden constraints) describes a bounded set B in R?, then the 
constrained maximum or minimum of f'(x, y) will occur either at a point (x, y) satisfying 
Vf (x, y) = AVg(x, y) or at a “boundary” point of the set B. 

In Example 2.24 the constraint equation 2x + 2y = 20 describes a line in R?, which by itself 
is not bounded. However, there are “hidden” constraints, due to the nature of the problem, 
namely 0 < x, y < 10, which cause that line to be restricted to a line segment in RÊ (including 
the endpoints of that line segment), which is bounded. 


Example 2.25. For a rectangle whose perimeter is 20 m, use the Lagrange multiplier method 
to find the dimensions that will maximize the area. 


Solution: As we saw in Example 2.24, with x and y representing the width and height, 
respectively, of the rectangle, this problem can be stated as: 


Maximize: f(x,y)2 xy 
given: g(x,y) 2 2x - 2y = 20 


Then solving the equation Vf (x, y) = AVg(x, y) for some A means solving the equations 


Il1See TAYLOR and MANN, $6.8 for more detail. 
12 Again, see TAYLOR and MANN. 
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of ôg ôf ôg 
— =A= — =A— ly: 
Ax Jx and By By’ namely 
y=2, 


x = 2A 


The general idea is to solve for A in both equations, then set those expressions equal (since 
they both equal A) to solve for x and y. Doing this we get 


so now substitute either of the expressions for x or y into the constraint equation to solve for 
x and y: 


20 = g(x,y) = 2x+2y = 2x 42x = 4x > x=5 > y=5 


There must be a maximum area, since the minimum area is 0 and f(5,5) = 25 > 0, so the 
point (5,5) that we found (called a constrained critical point) must be the constrained maxi- 
mum. 

.. The maximum area occurs for a rectangle whose width and height both are 5 m. 


Example 2.26. Find the points on the circle x? + y? = 80 which are closest to and farthest 
from the point (1,2). 


Solution: The distance d from any point (x, y) to the point (1,2) is 


d =\/(x-1)? + (y-2)? 


and minimizing the distance is equivalent to minimizing the square of the distance. Thus 
the problem can be stated as: 


Maximize (and minimize): f(x,y) = (x— 1? +(y- 2) 


given: g(x,y)= x? y? = 80 
Solving Vf (x, y) = AV g(x, y) means solving the following equations: 


2(x—1) = 2Ax, 
2(y-2) = 24y 


Note that x 4 0 since otherwise we would get —2 = 0 in the first equation. Similarly, y Z 0. 
So we can solve both equations for A as follows: 


2 
=A=— > xy-y-xy-2x > y=2x 
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Substituting this into g(x,y) = x? + y? = 80 yields 5x? = 80, x?4 y? 280 I2 


so x = +4. So the two constrained critical points are (4,8) and 
(—4, —8). Since f (4,8) = 45 and f (—4,—8) = 125, and since there 
must be points on the circle closest to and farthest from (1,2), 
then it must be the case that (4,8) is the point on the circle clos- 
est to (1,2) and (-4,—8) is the farthest from (1,2) (see Figure 
2.7.1). 

Notice that since the constraint equation x?-- y? = 80 describes 
a circle, which is a bounded set in R?, then we were guaranteed 
that the constrained critical points we found were indeed the 
constrained maximum and minimum. 


4,8) 


ys 


(-4,-8) 


Figure 2.7.1 


The Lagrange multiplier method can be extended to functions of three variables. 


Example 2.27. 


Maximize (and minimize): f(x,y,z)=x+z 


given: g(x,y,z) 2 x? y? - z2-21 


Solution: Solve the equation Vf (x, y,z) = AVg(x, y,z): 


1 = 2Ax 
0 = 2Ay 
1 = 2Az 


The first equation implies A 4 0 (otherwise we would have 1 = 0), so we can divide by À in the 

second equation to get y = 0 and we can divide by A in the first and third equations to get 

x= X =z. Substituting these expressions into the constraint equation g(x, y,z) = x? + y? + 
2 =: . . 416 . d. d z1 z1 . A d. 

z^ = ] yields the constrained critical points (45.0, 4 and (21,0, a). Since f (5.0, +] > 

f (1.0, =), and since the constraint equation x? + y? + z? = 1 describes a sphere (which is 

bounded) in R?, then 49 +] is the constrained maximum point and 7979» :J is the 


constrained minimum point. 


So far we have not attached any significance to the value of the Lagrange multiplier A. We 
needed 4 only to find the constrained critical points, but made no use of its value. It turns 
out that À gives an approximation of the change in the value of the function f(x,y) that we 
wish to maximize or minimize, when the constant c in the constraint equation g(x, y) 7 c is 
changed by 1. 
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For example, in Example 2.25 we showed that the constrained optimization problem 


Maximize: f(x,y)2 xy 
given: g(x,y) 2 2x - 2y = 20 
had the solution (x, y) = (5,5), and that A = x/2 = y/2. Thus, A = 2.5. In a similar fashion we 
could show that the constrained optimization problem 
Maximize: f(x,y)2 xy 
given: g(x,y) 2x - 2y - 21 
has the solution (x, y) = (5.25,5.25). So we see that the value of f(x, y) at the constrained 
maximum increased from f (5,5) = 25 to f (5.25,5.25) = 27.5625, i.e. it increased by 2.5625 


when we increased the value of c in the constraint equation g(x, y) = c from c = 20 to c= 21. 
Notice that A = 2.5 is close to 2.5625, that is, 


A = Af = f(new max. pt) - f(old max. pt). 


Finally, note that solving the equation Vf (x, y) = AVg(x, y) means having to solve a system 
of two (possibly nonlinear) equations in three unknowns, which as we have seen before, 
may not be possible to do. And the 3-variable case can get even more complicated. All of 
this somewhat restricts the usefulness of Lagrange's method to relatively simple functions. 
Luckily there are many numerical methods for solving constrained optimization problems, 
though we will not discuss them here.!? 


. Find the constrained maxima and minima of f (x, y) = 2x + y given that x? + y? = 4. 


_ 


. Find the constrained maxima and minima of f (x, y) = xy given that x? + 3y? — 6. 


oOo N 


. Find the points on the circle x? + y? = 100 which are closest to and farthest from the point 
(2,3). 


4. Find the constrained maxima and minima of f (x,y,z) = x + y? +2z given that 4x? + 9y? — 
362? = 36. 


5. Find the volume of the largest rectangular parallelepiped that can be inscribed in the 
ellipsoid 
x») y 2? 


st 54+ El. 
a? b2 c? 


13See BAZARAA, SHERALI and SHETTY. 


3 Multiple Integrals 


3.1 Double Integrals 


In single-variable calculus, differentiation and integration are thought of as inverse opera- 
tions. For instance, to integrate a function f (x) it is necessary to find the antiderivative of f, 
that is, another function F(x) whose derivative is f(x). Is there a similar way of defining in- 
tegration of real-valued functions of two or more variables? The answer is yes, as we will see 
shortly. Recall also that the definite integral of a nonnegative function f(x) 2 0 represented 
the area “under” the curve y = f(x). As we will now see, the double integral of a nonnegative 
real-valued function f (x, y) 2 0 represents the volume “under” the surface z = f (x, y). 

Let f(x,y) be a continuous function such that f(x,y) 2 0 for all (x, y) on the rectangle 
R ={(x,y):a <x <b,c<y<d}in R°. We will often write this as R = [a,b] x [c,d]. For any 
number xx in the interval [a,b], slice the surface z = f(x, y) with the plane x = x* parallel to 
the yz-plane. Then the trace of the surface in that plane is the curve f (x*, y), where x* is 
fixed and only y varies. The area A under that curve (i.e. the area of the region between the 
curve and the xy-plane) as y varies over the interval [c,d] then depends only on the value of 
x*. So using the variable x instead of x*, let A(x) be that area (see Figure 3.1.1). 


AZ 


z= f(x,y) 


Figure 3.1.1 The area A(x) varies with x 


Then A(x) = f, d f(x,y)dy since we are treating x as fixed, and only y varies. This makes 
sense since for a fixed x the function f(x,y) is a continuous function of y over the interval 
[c, d], so we know that the area under the curve is the definite integral. The area A(x) is a 
function of x, so by the "slice" or cross-section method from single-variable calculus we know 
that the volume V of the solid under the surface z = f (x, y) but above the xy-plane over the 
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rectangle R is the integral over [a,b] of that cross-sectional area A(x): 


b b d 
Y =- AG)dx =} ll fx, y) dy 


We will always refer to this volume as “the volume under the surface". The above expression 
uses what are called iterated integrals. First the function f(x, y) is integrated as a func- 
tion of y, treating the variable x as a constant (this is called integrating with respect to y). 
That is what occurs in the “inner” integral between the square brackets in equation (3.1). 
This is the first iterated integral. Once that integration is performed, the result is then an 
expression involving only x, which can then be integrated with respect to x. That is what 
occurs in the "outer" integral above (the second iterated integral). The final result is then 
a number (the volume). This process of going through two iterations of integrals is called 
double integration, and the last expression in equation (3.1) is called a double integral. 


dx (3.1) 


Notice that integrating f(x,y) with respect to y is the inverse operation of taking the 
partial derivative of f(x, y) with respect to y. Also, we could just as easily have taken the 
area of cross-sections under the surface which were parallel to the xz-plane, which would 
then depend only on the variable y, so that the volume V would be 


d 
y 


It turns out that in general! the order of the iterated integrals does not matter. Also, we will 
usually discard the brackets and simply write 


b 
f f(x, y)dx 


dy. (3.2) 


d pb 
ye f f(x,y)dxdy, (3.3) 


where it is understood that the fact that dx is written before dy means that the function 
f(x,y) is first integrated with respect to x using the “inner” limits of integration a and b, 
and then the resulting function is integrated with respect to y using the "outer" limits of 
integration c and d. This order of integration can be changed if it is more convenient. 


Example 3.1. Find the volume V under the plane z = 8x + 6y over the rectangle R = [0,1] x 
[0, 2]. 


ldue to Fubini’s Theorem. See Ch. 18 in TAYLOR and MANN. 
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Solution: We see that f(x, y)=8x+6y=>0 for 0<x< 1 and 0 < y < 2, so: 


2 pl 
V= f f (8x+6y)dxdy 
o Jo 


2 x=1 
= f e? «6| Jay 
0 x=0 


2 
f (4+6y)dy 


2 
2 
4y - 3y f 
= 20 


Suppose we had switched the order of integration. We can verify that we still get the same 
answer: 


1 p2 
Vz Í f (8x+6y)dydx 
0 J0 


1 =2 
= Í (oem Jes 
0 y-0 


1 
Í (16x + 12)dx 
0 


3 1 
8x^ + 12x à 


= 20 


Example 3.2. Find the volume V under the surface z = e**" over the rectangle R = [2,3] x 
[1,2]. 


Solution: We know that f(x, y) = e**” > 0 for all (x, y), so 


2 
= Í (et — ext2)g y 


2 
ES eg" *3 — el+2 j 


@ -et =(e* =e") = e5 96^ 4 e? 


Recall that for a general function f(x), the integral f f(x)dx represents the difference of 
the area below the curve y = f (x) but above the x-axis when f(x) 2 0, and the area above the 
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curve but below the x-axis when f(x) x 0. Similarly, the double integral of any continuous 
function f (x, y) represents the difference of the volume below the surface z = f (x, y) but above 
the xy-plane when f(x, y) 2 0, and the volume above the surface but below the xy-plane when 
f(x,y) <= 0. Thus, our method of double integration by means of iterated integrals can be 
used to evaluate the double integral of any continuous function over a rectangle, regardless 
of whether f(x, y) 2 0 or not. 


2m pn 
Example 3.3. Evaluate f f sin(x + y)dxd y. 
0 0 


Solution: Note that f(x, y) = sin(x+ y) is both positive and negative over the rectangle [0, 7] x 
[0,27]. We can still evaluate the double integral: 


2z p 2n x= 
f f sin(x + y)dxdy = f (- cos(x + »)| dy 
o Jo 0 x=0 


27 
(— cos(y 4 z) 4 cos y)dy 


2z 
= -sin(y +7) «siny|. = —Sgin3i; - sin27 - (— sin;t  sinO) 


=0 


A 

For Exercises 1-4, find the volume under the surface z = f(x, y) over the rectangle R. 
1. f(x, y) 7 4xy, R = [0,1] x [0,1] 2. f(x,y) - e***, R - [0,1] x [-1, 1] 

3. f(x, y) 2 x? +y, R 2 [0,1] x [0,1] 4. f(x, y) 2 x - xy y?, R 2 [1,2] x [0,2] 


For Exercises 5-12, evaluate the given double integral. 


1 p2 1 2 
5. Í f (1- yx? dxdy 6. f Í x(x+ y)dxdy 
0 J1 0 Jo 
2 pl 2 pl 
7. Í f (x+2)dxdy s. f f x(xy+sinx)dxdy 
0 Jo -1J-1 
z/2 pl na pen/2 
s. f f sese naxay 10. [| sinxcos(y — z)dxd y 
0 JO 0 JO 


2 p4 1 p2 
11. f Í xydxdy 12. f Í ldxdy 
0 J1 -1J-1 


13. Let M be a constant. Show that fÊ f Mdxdy=M(d-c)Xb-a). 
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3.2 Double Integrals Over a General Region 


In the previous section we got an idea of what a double integral over a rectangle represents. 
We can now define the double integral of a real-valued function f(x, y) over more general 
regions in R?. 

Suppose that we have a region R in the xy-plane that is bounded on the left by the vertical 
line x = a, bounded on the right by the vertical line x = b (where a < b), bounded below by 
a curve y = g,(x), and bounded above by a curve y = g;(x), as in Figure 3.2.1(a). We will 
assume that g,(x) and g;(x) do not intersect on the open interval (a,b) (they could intersect 
at the endpoints x =a and x = b, though). 


Ay Ay 
y = §2(x) 
2 d Ween ta eh 
if x) 
i x= h(y) 
y = g1(x) i Cpa as 
l : | R 
| EE x 
0 a b 0 
(a) Vertical slice: Je iy f(x, y)dydx (b) Horizontal slice: fÉ his f(x, y)dxdy 


Figure 3.2.1 Double integral over a nonrectangular region R 


Then using the slice method from the previous section, the double integral of a real-valued 


function f (x, y) over the region R, denoted by Í l f(x, y)d A, is given by 


R 
[| t»^ = T 


R 


ga»(x) 
i ; f(x, y)dy| dx (3.4) 


gi(x 


This means that we take vertical slices in the region R between the curves y = g(x) and 
y = g.(x). The symbol dA is sometimes called an area element or infinitesimal, with the A 
signifying area. Note that f (x, y) is first integrated with respect to y, with functions of x as 
the limits of integration. This makes sense since the result of the first iterated integral will 
have to be a function of x alone, which then allows us to take the second iterated integral 
with respect to x. 

Similarly, if we have a region R in the xy-plane that is bounded on the left by a curve 
x =h,(y), bounded on the right by a curve x = h,(y), bounded below by the horizontal line 
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y = c, and bounded above by the horizontal line y = d (where c < d), as in Figure 3.2.1(b) 
(assuming that h,(y) and A;(y) do not intersect on the open interval (c,d)), then taking 


horizontal slices gives 
I Il fG,y)dA = T 


Notice that these definitions include the case when the region R is a rectangle. Also, if 
f(x,y) = 0 for all (x, y) in the region R, then ff f(x, y)dA is the volume under the surface 
R 


holy) 
[EN opala (3.5) 


z = f(x,y) over the region R. 
Example 3.4. Find the volume V under the plane z = 8x + 6y over the region R = {(x,y):0 < 
x<1, 0< y< 2x}. 


Solution: The region R is shown in Figure 3.2.2. Using vertical slices we 
get: 


V = [| 6z+6yaa 
R 


1[ p2x? 
- f (8x+6y)dy| dx 
0 |Jo 
1 =2x2 
- (pres | dx 
0 y=0 


1 
= f (16x? + 12x*5) dx 


0 1 


Figure 3.2.2 


1 
Ax* + 3 zd =4+2= 2264 
0 


We get the same answer using horizontal slices (see Figure 3.2.3): 


V = [| &:«e»a4 
R 


2 


eee dy 


0 1 


0 


f (4x? " Ua] dy Figure 3.2.3 
0 


2 
[ou m = f (4 4y -3V/2y??)qd y 


dy + 2y? - $32 y^ = 8+8- $282 _ 169.28 = B- 64 
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Example 3.5. Find the volume V of the solid bounded by the three coordinate planes and 
the plane 2x + y + 4z = 4. 


(0,0,1) 2x +y+4z=4 


yœ 


(0,4,0) 


x (2,0,0) 


(a) (b) 


Figure 3.2.4 


Solution: The solid is shown in Figure 3.2.4(a) with a typical vertical slice. The volume V 
is given by [f f(x,y)dA, where f(x,y) = z = ia — 2x — y) and the region R, shown in Figure 
R 


3.2.4(b), is R = {(x,y):0 < x <2, 0 < y < -2x + 4). Using vertical slices in R gives 
y- Í 1(4-2x- y)dA 


dx 


y--2x-4 
=f [-ta-2-3 [^ Jas 


2 
= f ia- 2x)? dx 
0 


| 
JH 
um 
i 
| 
N 
R 
— 
ise) 
| 
Iz 
| 
p 


For a general region R, which may not be one of the types of regions we have considered so 
far, the double integral [f f (x, y)d.A is defined as follows. Assume that f(x, y) is a nonnega- 
R 


tive real-valued function and that R is a bounded region in R2, so it can be enclosed in some 
rectangle [a,b] x [c, d]. Then divide that rectangle into a grid of subrectangles. Only consider 
the subrectangles that are enclosed completely within the region R, as shown by the shaded 
subrectangles in Figure 3.2.5(a). In any such subrectangle [x;,x;.,] x [yj y;.1], pick a point 
(Xix, Yj). Then the volume under the surface z = f(x, y) over that subrectangle is approxi- 
mately f'(x,,, yj.) Ax, ^y;, where Ax; = xi, — xi, Ay; = yj — yj, and f (xi, Yj) is the height and 
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Ax; Ay; is the base area of a parallelepiped, as shown in Figure 3.2.5(b). Then the total vol- 
ume under the surface is approximately the sum of the volumes of all such parallelepipeds, 
namely 


> YS fey) Ax; Ay; , (3.6) 
j i 


where the summation occurs over the indices of the subrectangles inside R. If we take 

smaller and smaller subrectangles, so that the length of the largest diagonal of the subrect- 

angles goes to 0, then the subrectangles begin to fill more and more of the region R, and so 

the above sum approaches the actual volume under the surface z = f(x, y) over the region R. 

We then define [f f (x, y) dA as the limit of that double summation (the limit is taken over all 
R 


subdivisions of the rectangle [a,b] x [c,d] as the largest diagonal of the subrectangles goes 
to 0). 


PA 
d 
Az 
z = f(x,y) 
E 
Yj+ı ry i 
| 
(Xi, y Ja) | 
Vip | y 
| 
C | 
] ] x | 
0 a Xj Xii b 
(a) Subrectangles inside the region (b)  Parallelepiped over a subrectangle, 


with volume f(xi., yj.) Ax; Ay; 


Figure 3.2.5 Double integral over a general region R 


A similar definition can be made for a function f(x, y) that is not necessarily always non- 
negative: just replace each mention of volume by the negative volume in the description 
above when f (x, y) « 0. In the case of a region of the type shown in Figure 3.2.1, using the def- 
inition of the Riemann integral from single-variable calculus, our definition of [f f(x, y)d A 

R 


reduces to a sequence of two iterated integrals. 

Finally, the region R does not have to be bounded. We can evaluate improper double 
integrals (i.e. over an unbounded region, or over a region which contains points where the 
function f (x, y) is not defined) as a sequence of iterated improper single-variable integrals. 
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co plx? 
Example 3.6. Evaluate f f 2ydydx. 
1 0 


Solution: 
co pl/x? co yzl/x? 
f f 2ydyds = | [^| Jas 
1 JO 1 y=0 
oo 
iz -4 gn 1-3/9 _ 1) _ 1 
= Í x dx = —3Xx l. -0-(-30)-2 3 
A 
For Exercises 1-6, evaluate the given double integral. 
1 el T y» 
uff 24x?y d y dx 2. f f sinxdxdy 
0 Jyzz 0 Jo 
2 plnx 2 p2y ; 
s.f f 4xdydx af f e” dxdy 
1 Jo o Jo 
m2 py oo fco (2442 
5. f f cosxsinydzdy e. f Í xye dxdy 
o Jo 


2 py 1 px? 
7. I Í ldxdy 8. Í f 2dydx 
0 Jo o Jo 


9. Find the volume V of the solid bounded by the three coordinate planes and the plane 
x+y+z=l. 


10. Find the volume V of the solid bounded by the three coordinate planes and the plane 
9x +2y+5z=6. 


B 


11. Explain why the double integral [f 1dA gives the area of the region R. For simplicity, 


R 
you can assume that R is a region of the type shown in Figure 3.2.1(a). 


C 


12. Prove that the volume of a tetrahedron with mutually perpendic- 
ular adjacent sides of lengths a, b, and c, as in Figure 3.2.6, is abe 
(Hint: Mimic Example 3.5, and recall from 


Section 1.5 how three noncollinear points determine a plane.) 


13. Show how Exercise 12 can be used to solve Exercise 10. Figure 3.2.6 
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3.3 Triple Integrals 


Our definition of a double integral of a real-valued function f (x, y) over a region R in R? can 
be extended to define a triple integral of a real-valued function f(x, y,z) over a solid S in R. 
We simply proceed as before: the solid S can be enclosed in some rectangular parallelepiped, 
which is then divided into subparallelepipeds. In each subparallelepiped inside S, with sides 
of lengths Ax, Ay and Az, pick a point (x,, y,,2,). Then define the triple integral of f(x,y,z) 
over S, denoted by [ff f(x, y,z) dV, by 

S 


Í f(x,y,z)dV = lim)’ >’) f(x. yz) Ax Ay Az , (3.7) 
S 


where the limit is over all divisions of the rectangular parallelepiped enclosing S into sub- 
parallelepipeds whose largest diagonal is going to 0, and the triple summation is over all the 
subparallelepipeds inside S. It can be shown that this limit does not depend on the choice 
of the rectangular parallelepiped enclosing S. The symbol dV is often called the volume 
element. 

Physically, what does the triple integral represent? We saw that a double integral could 
be thought of as the volume under a two-dimensional surface. It turns out that the triple 
integral simply generalizes this idea: it can be thought of as representing the hypervolume 
under a three-dimensional hypersurface w = f(x,y,z) whose graph lies in R^. In general, 
the word “volume” is often used as a general term to signify the same concept for any n- 
dimensional object (e.g. length in R!, area in R2). It may be hard to get a grasp on the concept 
of the *volume" of a four-dimensional object, but at least we now know how to calculate that 
volume! 

In the case where S is a rectangular parallelepiped [x1, x2] x [yi, yo] x [21,22], that is, S = 
(x,y,2):xyS X € X2, Yı S Y S Y2, 2) S Z < Za}, the triple integral is a sequence of three iterated 


integrals, namely 
Z2 y2 X2 
J| re».9av zif f n f(x,y,z)dxdydz, (3.8) 
S Z1 y X1 


where the order of integration does not matter. This is the simplest case. 

A more complicated case is where S is a solid which is bounded below by a surface z — 
g(x,y), bounded above by a surface z = g(x,y), y is bounded between two curves h,(x) and 
h(x), and x varies between a and b. Then 


b pho(x) pgaGoy) 

Í fe»2av = [ | f(x,y,z)dzdydx. (3.9) 
a Jh 

S 


160 Jgilx,y) 


Notice in this case that the first iterated integral will result in a function of x and y (since its 
limits of integration are functions of x and y), which then leaves you with a double integral of 
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a type that we learned how to evaluate in Section 3.2. There are, of course, many variations 
on this case (for example, changing the roles of the variables x, y, z), so as you can probably 
tell, triple integrals can be quite tricky. At this point, just learning how to evaluate a triple 
integral, regardless of what it represents, is the most important thing. We will see some 
other ways in which triple integrals are used later in the text. 


3 p2 pl 
Example 3.7. Evaluate [ Í f (xy - z)dxdydz. 
o Jo Jo 


| [err masasae -f [ E lx?y | xz NADEL 
ff ły+z) dydz 
Z 1,2 2 
-f [io esp Ja: 


Solution: 


3 
= | a«2222 
0 
3 
- zz = 12 
0 


1 pl-x f2-x-y 
Example 3.8. Evaluate Í Í f (x+y+z)dzdydx. 
0 Jo 0 


Solution: 
l-x p2-x-y 1 pl-x 9 |272-x-y 
I f (x+y+z)dzdydx = [ox+ e+ be Le Jaya 
1 pl-x 
-|f (&+y2-x-y)+4(2-x-y)dydx 
Es 1,2 
= f (2- 3x^ -xy- 3y“) dydx 


1 zi 
y-1-x 
- 2y-lx)y-ixy?-1 3| Jax 
Í [z ZX Y—-3XY — GY y=0 
1 

zi (4 - 2x4 1x?) dx 

— il 2, 1,4 m7) 

—-76*-X + g4* | = 8 
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Note that the volume V of a solid in R? is given by 


y = Jff av (3.10) 
S 


Since the function being integrated is the constant 1, then the above triple integral reduces 
to a double integral of the types that we considered in the previous section if the solid is 
bounded above by some surface z = f(x,y) and bounded below by the xy-plane z = 0. There 
are many other possibilities. For example, the solid could be bounded below and above by 
surfaces z = g,(x,y) and z = g(x,y), respectively, with y bounded between two curves h,(x) 
and h,(x), and x varies between a and b. Then 


b pholx) pga(x,y) b phax) 
v= fff xav - | f f 1dzdyds- Í f (g5(x,y) - gi(x, y) dydx 
S a Jhi(x) Jgi(x,y) a Jhi(x) 


just like in equation (3.9). See Exercise 10 for an example. 


A 

For Exercises 1-8, evaluate the given triple integral. 
3 p2 pl l pex py 

r Í f f xyzdxdydz 2. Í f f xyzdzdydx 
o Jo Jo 0 Jo Jo 
AZ px pxy 9 1 pz py s 

: Í f Í x^sinzdzdydx 4. f f f ze" dxdydz 
o Jo Jo 0 Jo Jo 
e py ply 2 2 ey? pz? 

i f f i x“zdxdzdy 6. f f f yzdxdzdy 
1 Jo Jo 1 Jo Jo 
2 p4 p3 1 pl-x pl-x-y 

3 f f f ldxdydz 8. Í f Í ldzdydx 
1 J2 Jo 0 Jo 0 


9. Let M be a constant. Show that BER VA n Mdxdydz= M(z,- ziKy; — ys — xi). 
B 


en 


[^- 


Q 


PR 


10. Find the volume V of the solid S bounded by the three coordinate planes, bounded above 
by the plane x+ y +z = 2, and bounded below by the plane z = x+ y. 


C 


11. Show that f iM | f@dzdydz= |" (peur zs —— f(x)dx. (Hint: Think of how changing the 


order of integration in the triple integral oe the limits of integration.) 
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3.4 Numerical Approximation of Multiple Integrals 


As you have seen, calculating multiple integrals is tricky even for simple functions and 
regions. For complicated functions, it may not be possible to evaluate one of the iterated in- 
tegrals in a simple closed form. Luckily there are numerical methods for approximating the 
value of a multiple integral. The method we will discuss is called the Monte Carlo method. 
The idea behind it is based on the concept of the average value of a function, which you 
learned in single-variable calculus. Recall that for a continuous function f'(x), the average 
value f of f over an interval [a,b] is defined as 


n 1 b 
f- =S fG)dx. (3.11) 
b-a a 


The quantity b — a is the length of the interval [a,b], which can be thought of as the 
“volume” of the interval. Applying the same reasoning to functions of two or three variables, 
we define the average value of f (x, y) over a region R to be 


= 1 
f- m ll faa, (3.12) 


where A(R) is the area of the region R, and we define the average value of f (x,y,z) over a 
solid S to be 


1 
EET J ey. (3.13) 


where V(S) is the volume of the solid S. Thus, for example, we have 


Í Fi y)dA = ARF. (3.14) 
R 


The average value of f(x,y) over R can be thought of as representing the sum of all the 
values of f divided by the number of points in R. Unfortunately there are an infinite number 
(in fact, uncountably many) points in any region, i.e. they can not be listed in a discrete 
sequence. But what if we took a very large number N of random points in the region R 
(which can be generated by a computer) and then took the average of the values of f for 
those points, and used that average as the value of f? This is exactly what the Monte Carlo 
method does. So in formula (3.14) the approximation we get is 


G2 (f 
Í f(x,y)dA x amam EO, (3.15) 


R 


where » 
- an (x;, i) — 
ps Life nd r2 


XN (f(x, y 


N , (3.16) 
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with the sums taken over the N random points (x,, y;), ..., (xy, yy). The + “error term” in 
formula (3.15) does not really provide hard bounds on the approximation. It represents a 
single standard deviation from the expected value of the integral. That is, it provides a likely 
bound on the error. Due to its use of random points, the Monte Carlo method is an example 
of a probabilistic method (as opposed to deterministic methods such as Newton's method, 
which use a specific formula for generating points). 

For example, we can use formula (3.15) to approximate the volume V under the plane 
z = 8x + 6y over the rectangle R = [0,1] x [0,2]. In Example 3.1 in Section 3.1, we showed 
that the actual volume is 20. Below is a code listing (montecarlo.java) for a Java program 
that calculates the volume, using a number of points N that is passed on the command line 
as a parameter. 


//Program to approximate the double integral of f(x,y)=8x+6y 
//over the rectangle [0,1]x[0,2]. 
public class montecarlo { 
public static void main(String[] args) { 
//Get the number N of random points as a command-line parameter 
int N = Integer.parseInt(args[0]); 
double x = 0; //x-coordinate of a random point 
double y = 0; //y-coordinate of a random point 
double f = 0.0; //Value of f at a random point 
double mf = 0.0; //Mean of the values of f 
double mf2 = 0.0; //Mean of the values of f^2 
for (int i=0;i<N;i++) { //Get the random coordinates 
Math.random(); //x is between 0 and 1 
2 * Math.random(); //y is between 0 and 2 
8*x + 6*y; //Value of the function 
mf = mf + f; //Add to the sum of the f values 
mf2 = mf2 + f*f; //Add to the sum of the f^2 values 
} 
mf = mf/N; //Compute the mean of the f values 
mf2 = mf2/N; //Compute the mean of the f^2 values 
System.out.println("N = "+N + ": integral = " + vol()*mf + " +/- 
+ vol()«Math.sqrt((mf2 - Math.pow(mf,2))/N)); //Print the result 
} 
//The volume of the rectangle [0,1]x[0,2] 
public static double vol() { 
return 1*2; 


Listing 3.1 Program listing for montecarlo.java 


The results of running this program with various numbers of random points (e.g. java 
montecarlo 100) are shown below: 
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N = 10: 19.36543087722646 +/- 2.7346060413546147 

N = 100: 21.334419561385353 +/- 0.7547037194998519 

N = 1000: 19 .807662237526227 +/- 0.26701709691370235 
N = 10000: 20.080975812043256 +/- 0.08378816229769506 
N = 100000: 20.009403854556716 +/- 0.026346782289498317 
N = 1000000: 20.000866994982314 +/- 0.008321168748642816 


As you can see, the approximation is fairly good. As N — oo, it can be shown that the 
Monte Carlo approximation converges to the actual volume (on the order of O(vV/N), in com- 
putational complexity terminology). 

In the above example the region R was a rectangle. To use the Monte Carlo method for 
a nonrectangular (bounded) region R, only a slight modification is needed. Pick a rectangle 
É that encloses R, and generate random points in that rectangle as before. Then use those 
points in the calculation of f only if they are inside R. There is no need to calculate the area 
of R for formula (3.15) in this case, since the exclusion of points not inside R allows you to 
use the area of the rectangle É instead, similar to before. 

For instance, in Example 3.4 we showed that the volume under the surface z = 8x + 6y 
over the nonrectangular region R = ((x, y): 0€ x <1, 0 < y < 2x?) is 6.4. Since the rectangle 
R = [0,1] x [0,2] contains R, we can use the same program as before, with the only change 
being a check to see if y < 2x? for a random point (x, y) in [0,1] x [0,2]. Listing 3.2 below 
contains the code (montecarlo2.java): 


//Program to approximate the double integral of f(x,y)=8x+6y over the 
//region bounded by x=0, x-1, y=0, and y-2x^2 
public class montecarlo2 { 
public static void main(String[] args) { 
//Get the number N of random points as a command-line parameter 
int N - Integer.parseInt(args[0]); 
double x = 0; //x-coordinate of a random point 
double y = 0; //y-coordinate of a random point 
double f = 0.0; //Value of f at a random point 
double mf = 0.0; //Mean of the values of f 
double mf2 - 0.0; //Mean of the values of f^2 
for (int i=0;i<N;it++) { //Get the random coordinates 
x = Math.random(); //x is between 0 and 1 
y = 2 * Math.random(); //y is between 0 and 2 
if (y « 2*Math.pow(x,2)) ( //The point is in the region 
f = 8*x + 6*y; //Value of the function 
mf = mf + f; //Add to the sum of the f values 
mf2 = mf2 + f*f; //Add to the sum of the f^2 values 
} 
} 
mf = mf/N; //Compute the mean of the f values 
mf2 = mf2/N; //Compute the mean of the f^2 values 
System.out.println("N = " + N + ": integral = " + vol()*mf + 
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"ox/- " + vol()«Math.sqrt((mf2 - Math.pow(mf,2))/N)); 
} 
//The volume of the rectangle [0,1]x[0,2] 
public static double vol() { 
return 1*2; 
} 
} 


Listing 3.2 Program listing for montecarlo2.java 


The results of running the program with various numbers of random points (e.g. java 
montecarlo2 1000) are shown below: 


= 10: integral = 6.95747529014894 +/- 2.9185131565120592 
= 100: integral = 6.3149056229650355 +/- 0.9549009662159909 
= 1000: integral = 6.477032813858756 +/- 0.31916837260973624 


= 100000: integral = 6.440184132811864 +/- 0.03200476870881392 
= 1000000: integral = 6.417050897922222 +/- 0.01009454409789472 


P ee — ee RE 


6. 
6. 
6. 
- 10000: integral = 6.349975080015089 +/- 0.10040086346895105 
6. 
6. 


To use the Monte Carlo method to evaluate triple integrals, you will need to generate 
random triples (x, y,z) in a parallelepiped, instead of random pairs (x, y) in a rectangle, and 
use the volume of the parallelepiped instead of the area of a rectangle in formula (3.15) (see 
Exercise 2). For a more detailed discussion of numerical integration methods, see PRESS et 
al. 


1. Write a program that uses the Monte Carlo method to approximate the double integral 
[f e* dA, where R = [0,1] [0,1]. Show the program output for N = 10, 100, 1000, 10000, 


R 
100000 and 1000000 random points. 


2. Write a program that uses the Monte Carlo method to approximate the triple integral 
Sff €9* dV, where S = [0,1] x [0,1] x [0,1]. Show the program output for N = 10, 100, 


S 
1000, 10000, 100000 and 1000000 random points. 
3. Repeat Exercise 1 with the region R = {(x,y):-1<x <1, 0 < y < x?). 


4. Repeat Exercise 2 with the solid S = {(x,y,z):0<x<1, 0O<y<1, 0<z<1-x-y}. 


5. Use the Monte Carlo method to approximate the volume of a sphere of radius 1. 


N 


2 
6. Use the Monte Carlo method to approximate the volume of the ellipsoid a + T qp 
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3.5 Change of Variables in Multiple Integrals 


Given the difficulty of evaluating multiple integrals, the reader may be wondering if it is 
possible to simplify those integrals using a suitable substitution for the variables. The an- 
swer is yes, though it is a bit more complicated than the substitution method which you 
learned in single-variable calculus. 

Recall that if you are given, for example, the definite integral 


2 
f x2 Vx2-1dx , 
1 


then you would make the substitution 


2 


u=x?-1 > x*=u+4+1 


du=2xdx 
which changes the limits of integration 


x=1> u=0 


x=2> u=3 


so that we get 


2 
Í x?v x? -1dx 
1 


ix?.2xV x?—1dx 


i(u-*l)vudu 


i 
Í 


3 
i f (u” ce 2) du , which can be easily integrated to give 


_ 14⁄3 
am 


Let us take a different look at what happened when we did that substitution, which will give 
some motivation for how substitution works in multiple integrals. First, we let u = x? — 1. 
On the interval of integration [1,2], the function x — x? — 1 is strictly increasing (and maps 
[1,2] onto [0,3]) and hence has an inverse function (defined on the interval [0,3]). That is, 
on [0,3] we can define x as a function of u, namely 


x = g(u) = Vu«*l. 
Then substituting that expression for x into the function f(x) = x? Vx? — 1 gives 


f(x) = f(g(u)) = (u- 1PP Vu, 
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and we see that 


Ost g'(u) > dx = g'(u)du 
du 


dx = u+) du, 
so since 


g(0)=1 > 0=g 1 
g(3)=2 > 32g 2) 


then performing the substitution as we did earlier gives 


2 2 
f teas = | x? Vx2-1dx 
1 1 
3 
- | s(u + 1)Vudu , which can be written as 
0 


3 
= f (w+ 19? vu -1u 1)? du , Which means 
0 


2 g 2) 
f f(x)dx = f f(gt))g'(u)du . 
1 g 1) 


In general, if x = g(u) is a one-to-one, differentiable function from an interval [c,d] (which 
you can think of as being on the *u-axis") onto an interval [a,b] (on the x-axis), which means 
that g'(u) Z 0 on the interval (c,d), so that a = g(c) and b = g(d), then c = g^!(a) and d = 
g |(b), and 


zs 
i f(eu)g'(u)du . (3.17) 


b g (b 
f EE f 
a gla 


This is called the change of variable formula for integrals of single-variable functions, and it 
is what you were implicitly using when doing integration by substitution. This formula turns 
out to be a special case of a more general formula which can be used to evaluate multiple 
integrals. We will state the formulas for double and triple integrals involving real-valued 
functions of two and three variables, respectively. We will assume that all the functions 
involved are continuously differentiable and that the regions and solids involved all have 
“reasonable” boundaries. The proof of the following theorem is beyond the scope of the text.” 


2See TAYLOR and MANN, § 15.32 and § 15.62 for all the details. 
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Theorem 3.1. Change of Variables Formula for Multiple Integrals 
Let x = x(u,v) and y = y(u,v) define a one-to-one mapping of a region R' in the uv-plane onto 
a region R in the xy-plane such that the determinant 


Ox Ox 
du dv 
dy Oy 
du dv 


J(u,v) = 


is never 0 in R’. Then 


[| fanaa = || (esos tatu tate, n. (3.19) 
R' 


R 


We use the notation d A(x, y) and dA(u,v) to denote the area element in the (x, y) and (u,v) 
coordinates, respectively. 

Similarly, if x = x(u,v,w), y = y(u,v,w) and z = z(u,v,w) define a one-to-one mapping of 
a solid S' in uvw-space onto a solid S in xyz-space such that the determinant 


Ox Ox 
ðv dw 
dy Oy 
ðv dw 
Oz Oz 


ðv ôw 


is never 0 in S’, then 


[|| re». aves [|| fetu. os w, yo m zo viso avs, vw). (3.21) 
S Ss! 


The determinant J(u,v) in formula (3.18) is called the Jacobian of x and y with respect 
to u and v, and is sometimes written as 
Ox, y) 


J(u,v) = aua" (3.22) 


Similarly, the Jacobian J(u,v,w) of three variables is sometimes written as 


alx, y, z) 


co (3.23) 


J(u,v,w) = 
Notice that formula (3.19) is saying that d A(x, y) - |J(u,v)| dA(u,v), which you can think of 
as a two-variable version of the relation dx = g'(u)du in the single-variable case. 
The following example shows how the change of variables formula is used. 
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Example 3.9. Evaluate I es dA, where R = ((x,y):xz0,y 20,x*- yx 1). 
R 


Solution: First, note that evaluating this double integral without using substitution is prob- 
ably impossible, at least in a closed form. By looking at the numerator and denominator of 
the exponent of e, we will try the substitution u = x — y and v = x+ y. To use the change of 
variables formula (3.19), we need to write both x and y in terms of u and v. So solving for 
x and y gives x= iu +v) and y= i(v — u). In Figure 3.5.1 below, we see how the mapping 
x=x(u,v)= i(u +v), y= y(u,v)= i(v — u) maps the region R' onto R in a one-to-one manner. 


y AU 


Figure 3.5.1 The regions R and R' 


Now we see that 


Ox Ox PT 

du dv 2 3 1 qi. 1 
J ; — — =- D> J ; —|—-|—-—, 
(u,v) dy dy | = 1 | 2 |J(u,v)| E 2 

Ou Ov 


so using horizontal slices in R’, we have 


[| 2^ - J| resorts mar taa 
R R' 


ll 
aR 
G 
| 
G 
| 
mm 
© 
II 
| 
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The change of variables formula can be used to evaluate double integrals in polar coordi- 
nates. Letting 
x = x(r,0) = rcosü and y = y(r,0) = rsiné, 


we have 
Ox Ox 
ar 39 cos -—rsin0O 
J(u,v) = ar OO) es = rcos?0 « rsin?0 = r > |J(u,v)| = Irl =r, 
Oy Oy sinÜ rcosé 
ôr 00 


so we have the following formula: 


Double Integral in Polar Coordinates 


[| fenaxay = J| Fo coso,rsinorarao, (3.24) 
R' 


R 


where the mapping x = rcos0, y = rsin@ maps the region R' in the r0-plane onto the 
region R in the xy-plane in a one-to-one manner. 


Example 3.10. Find the volume V inside the paraboloid z = x? + y? for 0 € z < 1. 


Solution: Using vertical slices, we see that 


V= |[a-aea = J[ a- a4. 
R R 


where R = ((x, y) : x? + y? < 1} is the unit disk in R? (see 
Figure 3.5.2). In polar coordinates (7,8) we know that 
x? 4 y? = r? and that the unit disk R is the set R' = ((r,0): 
0zrz1,0zx0«z2m). Thus, 


2m pl - XX 
V = f [a-r )rdrd0 Figure 3.5.2 ase 45? 


2m pl 
al f (r ^ r)drd0 
0 0 


ll 
NI a 5 
S 

Ale 

Q 

jen) 
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Example 3.11. Find the volume V inside the cone z = y x2 + y? for0 x z <1. 


Solution: Using vertical slices, we see that 
y = [[ a- 524 = If i-e dA , 
R R 


where R = ((x, y) : x? + y? < 1) is the unit disk in R? 
(see Figure 3.5.3). In polar coordinates (r,0) we know 
that x? 4 y? =r and that the unit disk R is the set 
R'-((rj,9:0zrz1,0x0z2z). Thus, 


2m pl 
V e f &- rarae 
0 0 
2m pl 
zi f «rarae 
0 0 
-['( E 
d 0 2 3 


EX 


Figure 3.5.3 z= \/x2+ y? 


j 
w| a 5 
y 
l= 
Q 
D 


In a similar fashion, it can be shown (see Exercises 5-6) that triple integrals in cylindrical 
and spherical coordinates take the following forms: 


Triple Integral in Cylindrical Coordinates 


Í FG,» dxdydz = [| f(rcos0,rsin0,z)rdrd0dz, (3.25) 
S S! 


where the mapping x = rcos0, y = rsin0, z = z maps the solid S’ in r0z-space onto the 
solid S in xyz-space in a one-to-one manner. 


Triple Integral in Spherical Coordinates 


Í f(x,y,z)dxdydz = Í f(psin cos0, p sin sin, p cos b) p? sinddpdddé, (3.26) 
S S! 


where the mapping x = psin cos0, y = psing sin0, z = pcos maps the solid S' in po0- 
space onto the solid S in xyz-space in a one-to-one manner. 
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Example 3.12. For a > 0, find the volume V inside the sphere S = x? + y? + z? =a?. 


Solution: We see that S is the set p =a in spherical coordinates, so 


2m pm pa 
v= f[frev = | f | 16? sinvapagae 
0 Jo JO 
S 
2z pz 3 o=a 2n pm 43 
af f a | sinpaao = | © sin$d$d0 
o Jo (3 lp-0 o Jo 3 
2n 


3 zs 2n 9 3 4 3 
-f [-S esol; i do s a gi, 
o | 38 $-0 o 8 3 


A 

1. Find the volume V inside the paraboloid z = x? + y? for 0 € z < 4. 

2. Find the volume V inside the cone z = yx? + y? for 0 € z <3. 

B 

3. Find the volume V of the solid inside both x? + y? +z? 2 4 and x? + y? - 1. 

4. Find the volume V inside both the sphere x? + y? +z? = 1 and the cone z = v/x?  y2 3 
5. Prove formula (3.25). 6. Prove formula (3.26). 


7. Evaluate [f sin (>) cos(=;*) dA, where R is the triangle with vertices (0,0), (2,0) and 
(1, 1). (Hint: Use the change of variables u = (x + yy2, v = (x — yy2.) 

8. Find the volume of the solid bounded by z = x? + y? and z? = A(x? + y?). 

9. Find the volume inside the elliptic cylinder 5 + = =1for0<z<2. 

C 


10. Show that the volume inside the ellipsoid £ t ^ + 5 -]1is Angbe | (Hint: Use the change 


of variables x 2 au, y = bu, z= cw, then consider Example 3.12.) 


11. Show that the Beta function, defined by 
1 
B(x,y) = Í 41-24) gt, forx>0,y>0, 
0 


satisfies the relation B(y,x) = B(x, y) for x » 0, y » 0. 


12. Using the substitution t = u/(u + 1), show that the Beta function can be written as 


co ut 
B(x,y) = i, upo oY? for x>0, y » 0. 
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3.6 Application: Center of Mass 


Recall from single-variable calculus that for a region "m 
R ={(x,y):a <x < b,0 < y < f(x)} in R? that represents y=f(x) 

a thin, flat plate (see Figure 3.6.1), where f(x) is a con- > is, 
tinuous function on [a,5], the center of mass of R has 
coordinates (X, y) given by 


0 a b 
z=— and y=— 
M M’ Figure 3.6.1 Center of mass of R 


where 


b 2 b b 
m= | T dx, My= | xf(x)dx , m= | f(x)dx , (3.27) 


assuming that R has uniform density, i.e the mass of R is uniformly distributed over the 
region. In this case the area M of the region is considered the mass of R (the density is 
constant, and taken as 1 for simplicity). 

In the general case where the density of a region (or lamina) R is a continuous function 
5 = 6(x, y) of the coordinates (x, y) of points inside R (where R can be any region in R?) the 
coordinates (x, y) of the center of mass of R are given by 


M M, 
x= a and y = M , (3.28) 
where 
My= || 356.524. Mz= | v6.24. m= || 562A ; (3.29) 
R R R 


The quantities M; and M, are called the moments (or first moments) of the region R about 
the x-axis and y-axis, respectively. The quantity M is the mass of the region R. To see this, 
think of taking a small rectangle inside R with dimensions Ax and Ay close to 0. The mass 
of that rectangle is approximately ó(x,, y,)Ax Ay, for some point (x,, y.) in that rectangle. 
Then the mass of R is the limit of the sums of the masses of all such rectangles inside R as 
the diagonals of the rectangles approach 0, which is the double integral ff ó(x,y)d A. 


R 
Note that the formulas in (3.27) represent a special case when 6(x, y) = 1 throughout R in 
the formulas in (3.29). 


Example 3.13. Find the center of mass of the region R = (x, y): 0x < 1, 0 < y < 2x?), if the 
density function at (x, y) is lx, y) 2 x+ y. 


3.6 Application: Center of Mass 


Solution: The region R is shown in Figure 3.6.2. We have 


M = [| naa 
R 
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1 p2x? 
-|f (x+y)dydx 0 1 
o Jo 
i y? "| Figure 3.6.2 
zT xy+— dx 
0 2 y=0 
1 
= f (2x? + 2x4) dx 
0 
x^ 2x5]! 9 
= — + — z= — 
2 5 lo 10 
and 
M; = ECO M, = J| :5.52A 
R R 
1 p2x? 1 p2x? 
-|f y(x+y)dydx -|f x(x* y)dydx 
o Jo o Jo 
L fan 92x 1 2 y= 2x? 
-f fan E -f [eye e: 
1 1 
- Í (2x5 + —)dx = f (2x* + 2x°)dx 
0 0 
xê Ba" _ 5 ee eee 
3 21l 7 = 5 3ļ 15’ 


so the center of mass (x, y) is given by 


M, 11/15 232 _ = My 5 


_ 50 


M 910 27’ > M 9/0 


63 . 


Note how this center of mass is a little further towards the upper corner of the region R than 
when the density is uniform (it is easy to use the formulas in (3.27) to show that (x, y) = (2, 3) 
in that case). This makes sense since the density function 6(x, y) = x+ y increases as (x, y) 


approaches that upper corner, where there is quite a bit of area. 


In the special case where the density function 6(x, y) is a constant function on the region 


R, the center of mass (x, y) is called the centroid of R. 
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The formulas for the center of mass of a region in RÊ can be generalized to a solid S in R?. 
Let S be a solid with a continuous mass density function ó(x, y,z) at any point (x,y,z) in S. 
Then the center of mass of S has coordinates (x, y, z), where 


j= ,2- (3.30) 


where 


Myz = [J| 9&».9av. M,, = |[[v9@s,204V., Mx, = [J| 9 ».9av. (3.31) 
S S S 
M = I raay. (3.32) 
S 


In this case, My;, M,z and Myy are called the moments (or first moments) of S around the 
yz-plane, xz-plane and x y-plane, respectively. Also, M is the mass of S. 


Example 3.14. Find the center of mass of the solid S = ((x,y,2):z 2 0, x? +y? +2? « a°}, if 
the density function at (x, y,z) is ô(x,y,z)= 1. 


Solution: The solid S is just the upper hemisphere inside the sphere 
of radius a centered at the origin (see Figure 3.6.3). So since the 
density function is a constant and S is symmetric about the z-axis, 
then it is clear that x = 0 and y = 0, so we need only find Zz. We have 


M = J| os.2aV = ff av = Volumes 
S S * 


But since the volume of S is half the volume of the sphere of radius 
a, Which we know by Example 3.12 is m , then M = 2m. And 


Mx, = J| 5e».2av 
S 


- Í ll ll zdV , which in spherical coordinates is 
S 


Figure 3.6.3 


2z pnz/2 pa 
= f f f (p coso) p? sinddpdddé 
0 0 0 


= rr sing sse pap] dod0 


2m pa , 
- f Í & sing coso d$ d0 
0 0 
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2m pr , 
Myy = Í f S sin2ġdġd0 (since sin29 = 2sinġ cos) 
0 0 


2n p=n/2 
= f -5 cos2¢| | ao 
0 


$=0 
2z 
at 
= = dé 
E 
» na* 
Apr 
So n 
255, Mxy _ T _ 3a 
e M 21a? 8 
3 


Thus, the center of mass of S is (x, y, z) = (0,0, $). 


E Exercises 1-5, find the center of mass of the region R with the given density function 
ó(x, y). 

1. R-(x,y):02xz2,0zyz4),6(x, y) - 2y 

2. R-((x,y):0xxs1,0xyzx?),6(x,y) xy 

3. Rz (xy) :y 20, 3? y? <a}, S(x,y) 21 

4. R- (x,y): y 20, x 20, 1<x2 4+ y? <4}, d(x, y) = Vx + y? 

5 

B 


. Rz (x,y):y 20, x? +y? <1}, 6(,y) 2 y 


For Exercises 6-10, find the center of mass of the solid S with the given density function 
O(x, y,z). 


6. S={(x,y,z):0<x«<1, Os y<1, O<z<1}, d(x, y,z)=xyz 
7. S x ((x,y,2):22 0, x? y? +22 <a}, 6(x, y, 2) = x? y? +27 
8. S={(x,y,z):x20, y 20, 220, x? y? - z2« a?), 6(x, y,z) 21 


9. S={(x,y,z):0<x<1, 0<y<1, 0zzz1)0(x,y,2)- x?- y? +2? 


10. S= {(x,y,z):0<x<1, 0<y<1,0<z<1-x-y}, lx, y,z)=1 
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3.7 Application: Probability and Expected Value 


In this section we will briefly discuss some applications of multiple integrals in the field of 
probability theory. In particular we will see ways in which multiple integrals can be used to 
calculate probabilities and expected values. 


Probability 


Suppose that you have a standard six-sided (fair) die, and you let a variable X represent 
the value rolled. Then the probability of rolling a 3, written as P(X = 3), is s since there 
are six sides on the die and each one is equally likely to be rolled, and hence in particular 
the 3 has a one out of six chance of being rolled. Likewise the probability of rolling at most a 
3, written as P(X x 3), is 3 = i, since of the six numbers on the die, there are three equally 
likely numbers (1, 2, and 3) that are less than or equal to 3. Note that P(X < 3) = P(X = 
1)+ P(X = 2)+ P(X 23). We call X a discrete random variable on the sample space (or 
probability space) Q consisting of all possible outcomes. In our case, Q = (1,2,3,4,5,6). An 
event A is a subset of the sample space. For example, in the case of the die, the event X < 3 
is the set (1,2,3]. 


Now let X be a variable representing a random real number in the interval (0,1). Note 
that the set of all real numbers between 0 and 1 is not a discrete (or countable) set of values, 
ie. it can not be put into a one-to-one correspondence with the set of positive integers.? In 
this case, for any real number x in (0,1), it makes no sense to consider P(X = x) since it must 
be 0 (why?). Instead, we consider the probability P(X < x), which is given by P(X < x)= x. 
The reasoning is this: the interval (0, 1) has length 1, and for x in (0,1) the interval (0,x) 
has length x. So since X represents a random number in (0,1), and hence is uniformly 
distributed over (0, 1), then 


length of (0, x) x 
Poe apa BO eee, 
pee ehe > i 


We call X a continuous random variable on the sample space Q = (0,1). An event A isa 
subset of the sample space. For example, in our case the event X < x is the set (0, x). 


In the case of a discrete random variable, we saw how the probability of an event was the 
sum of the probabilities of the individual outcomes comprising that event (e.g. P(X < 3)= 
P(X = 1)+ P(X =2)+ P(X = 3) in the die example). For a continuous random variable, the 
probability of an event will instead be the integral of a function, which we will now describe. 


Let X be a continuous real-valued random variable on a sample space Q in R. For sim- 


3Fora proof see p. 9-10 in KAMKE, E., Theory of Sets, New York: Dover, 1950. 
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plicity, let Q = (a, b). Define the distribution function F of X as 


F(x) = P(X <x), for-oo«x«oo (3.33) 
1, forxzb 
= 4 P(X <x), fora<x<b (3.34) 
0, forx<a. 


Suppose that there is a nonnegative, continuous real-valued function f on R such that 
x 
F(x) = / f(ydy, for -co<x<oo, (3.35) 
—oo 


and 


oo 
[reas = 1. (3.36) 
—oo 
Then we call f the probability density function (or p.d.f. for short) for X. We thus have 
x 
P(X <x) = f f(y)dy, fora<x<b. (3.37) 
a 
Also, by the Fundamental Theorem of Calculus, we have 
F'(x) = f(x), for-oo«x«oo. (3.38) 


Example 3.15. Let X represent a randomly selected real number in the interval (0,1). We 
say that X has the uniform distribution on (0, 1), with distribution function 


1, forx=1 
F(x) = P(X <x) = 4x, for0«x«1 (3.39) 
0, forx<0, 


and probability density function 


; 1, for0«x«1 
fœ) = F (x) = (3.40) 
0, elsewhere. 
In general, if X represents a randomly selected real number in an interval (a,b), then X has 
the uniform distribution function 


1, for x> b 
F(x) = P(X <x) = 4 7%, fora<x<b (3.41) 
0, forx<a, 


and probability density function 


1 
LT, f «x«b 

f(x) = F(x) = {ea CETT (3.42) 
0, elsewhere. 
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Example 3.16. A famous distribution function is given by the standard normal distribution, 
whose probability density function f is 


1 
f(x) = ——e**, for -c0< x «oo. (3.43) 


V2n 


This is often called a “bell curve”, and is used widely in statistics. Since we are claiming that 
f isap.d.f., we should have 


ee T —x?/2 
——e dx =1 (3.44) 
].- 


by formula (3.36), which is equivalent to 
is -x?[2 
f e dx = v2n. (3.45) 
—oo 


We can use a double integral in polar coordinates to verify this integral. First, 


f T e C +y’N2 dxdy = F gp» uU e? ax) dy 
= is e 2 ax) uU. eV ay] 
oo A 2 
(ea) 


since the same function is being integrated twice in the middle equation, just with different 
variables. But using polar coordinates, we see that 


2 [7 -0+2 PEPO jajo 
f f ety 1i dxdy zx f e rdrd0 
ck UN o Jo 


2z 
E 
zi [e 
0 


27 Qn 
= f (0-(-e do = | ld0 = 27, 
0 0 


and so 


2z , and hence 


MT E 
fl e~ ax) 


mE 
f e *'^dx = V2r. 
=00 
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In addition to individual random variables, we can consider jointly distributed random 
variables. For this, we willlet X, Y and Z be three real-valued continuous random variables 
defined on the same sample space Q in R (the discussion for two random variables is similar). 
Then the joint distribution function F of X, Y and Z is given by 

F(x,y,z) = P(X <x, Y <y, Z<z), for-oo«x,y,z«oo. (3.46) 


If there is a nonnegative, continuous real-valued function f on R? such that 


z y x 
Fayz) = [ f f f(u,v,w)dudvdw, for -co«x,y,z «oo (3.47) 


and fe een oie 
I f f f(x,y,z)dxdydz = 1, (3.48) 


then we call f the joint probability density function (or joint p.d.f. for short) for X, Y and Z. 
In general, for a, < b,, a, < b2, a < b, we have 


bs poe pbi 
Pla, «X <b, aa< Y <b, a< Z <b) = f f f(x,y,z)dxdydz, (3.49) 
a3 a» ay, 


with the < and < symbols interchangeable in any combination. A triple integral, then, can 
be thought of as representing a probability (for a function f which is a p.d.f.). 


Example 3.17. Let a, b, and c be real numbers selected randomly from the interval (0,1). 
What is the probability that the equation ax? bx +c 2 0 has at least one real solution x? 


Solution: We know by the quadratic formula that there is at least i 
one real solution if b?—4ac = 0. So we need to calculate P(b? —4ac = 
0). We will use three jointly distributed random variables to do this. 1 D 
First, since 0< a,b,c <1, we have N c= i 
b?-4ac = 0 © 0 < 4ac < b? «16 0«2/avy/cx b «1, Ry Rw $ 
1 1 >. 
0 1 1 
where the last relation holds for all 0 < a,c <1 such that 4 


Figure 3.7.1 Region 


1 
D dapes de eq R=R,UR, 
a 


Considering a, b and c as real variables, the region R in the ac-plane where the above 
relation holds is given by R = {(a,c):0<a<1, 0<c<1, 0<c< i) which we can see is a 
union of two regions R, and R,, as in Figure 3.7.1 above. 


Now let X, Y and Z be continuous random variables, each representing a randomly se- 
lected real number from the interval (0,1) (think of X, Y and Z representing a, b and c, 
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respectively). Then, similar to how we showed that f(x) = 1 is the p.d.f. of the uniform dis- 
tribution on (0, 1), it can be shown that f(x, y,z)=1 for x, y, z in (0,1) 
(0 elsewhere) is the joint p.d.f. of X, Y and Z. Now, 


P(b?—4ac 20) = P((a,c)e R, 2VaVe<b<1), 


so this probability is the triple integral of f(a,b,c)=1 as b varies from 2a c to 1 and as 
(a,c) varies over the region R. Since R can be divided into two regions R, and R,, then the 
required triple integral can be split into a sum of two triple integrals, using vertical slices in 
R: 


l4 pl pl 1 l4a pl 
P(b? —4ac 20) zil Í Í 1dbdeda + | f Í 1ldbdcda 
0 0 J2Ja Vc 1/4J0 2/a yc 


Ry Re 


1⁄4 pl 1 pl/4a 
=i f a-3vavoaeda + | | (1-2VaVc)dcda 
o Jo 1/4 Jo 


c=1/4a 
da 
0 


c= 


Me 3/2 |651 A 3/2 
zi c- dva | | da -f c- dva 
0 c=0 1/4 


/4 
1/4 1 
8 1 
= a- —a?? + —Ina 
9 0 12 1⁄4 
1 1 1. 1 1 
z 1-3] " o- Sin] mec tula 
4 9 12 4) 36 12 
54+31n4 
P(b?—4ac =0) = T ~ 0.2544 


In other words, the equation ax? + bx +c =0 has about a 25% chance of being solved! 


Expected Value 


The expected value EX of a random variable X can be thought of as the “average” value 
of X as it varies over its sample space. If X is a discrete random variable, then 


EX = Y x P(X-x), (3.50) 


with the sum being taken over all elements x of the sample space. For example, if X repre- 
sents the number rolled on a six-sided die, then 


6 6 1 
EX = } «PÆ =1)= } xz = 85 (3.51) 
x=1 


x=1 


is the expected value of X, which is the average of the integers 1-6. 
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If X is a real-valued continuous random variable with p.d.f. f, then 
oo 
EX - f xf(x)dx. (3.52) 
—oo 


For example, if X has the uniform distribution on the interval (0, 1), then its p.d.f. is 
1, for0«x«1 
(x) = (3.53) 
f | 0, elsewhere, 


and so 


oo 1 
EX - f xf(x)dx = Í xdx = > (3.54) 
—oo 0 


For a pair of jointly distributed, real-valued continuous random variables X and Y with 
joint p.d.f. f(x, y), the expected values of X and Y are given by 


EX - Í Í xf(x,ydxdy and EY =| f yfG,y)dxdy, (3.55) 
respectively. 


Example 3.18. If you were to pick n > 2 random real numbers from the interval (0, 1), what 
are the expected values for the smallest and largest of those numbers? 


Solution: Let U;,...,U, be n continuous random variables, each representing a randomly 
selected real number from (0,1), i.e. each has the uniform distribution on (0,1). Define 
random variables X and Y by 


X-min(U;,...,U,) and Y -max(U,,...,U,). 
Then it can be shown‘ that the joint p.d.f. of X and Y is 


n(n-1Xy-x)"?, for0zsxzysz1 


f(x,y) = | (3.56) 


0, elsewhere. 


Thus, the expected value of X is 


1 pl 
EX = Í f n(n - Dx(y - x ?dydx 
0 Jx 


1 = 
= f [o-o Je 
0 y=x 


1 
f nx(1- x)" ldx , so integration by parts yields 
0 


1 1 
E 1- n eee 6) ee n+1 
x(1—x) D x) 4 
1 
n4l' 


4See Ch. 6 in HOEL, PORT and STONE. 
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and similarly (see Exercise 3) it can be shown that 


l pry 9 n 
EY = f f n(n—-1)y(y-x)" ^dxdy = ——. 
0 JO n+1 


So, for example, if you were to repeatedly take samples of n = 3 random real numbers from 
(0,1), and each time store the minimum and maximum values in the sample, then the aver- 
age of the minimums would approach i and the average of the maximums would approach 
3 as the number of samples grows. It would be relatively simple (see Exercise 4) to write a 
computer program to test this. 


1. Evaluate the integral f/^5, e^* dx using anything you have learned so far. 


B 


co 1 ,-(x-uY/2o? 
2. For a » 0 and p > 0, evaluate J o =e“ dx. 
3. Show that EY = — in Example 3.18 
C 


4. Write a computer program (in the language of your choice) that verifies the results in 
Example 3.18 for the case n = 3 by taking large numbers of samples. 


5. Repeat Exercise 4 for the case when n = 4. 


6. For continuous random variables X, Y with joint p.d.f. f(x, y), define the second moments 
E(X?) and E(Y?) by 


E(X?) = n i x?f(x,y)dxdy and E(Y?)- f. T y? f(x, y)dxdy, 
and the variances Var(X) and Var(Y ) by 
Var(X) = E(X?) -(EX) and Var(Y) = E(Y))-(EYY. 
Find Var(X) and Var(Y) for X and Y as in Example 3.18. 


7. Continuing Exercise 6, the correlation p between X and Y is defined as 
E(XY)-(EX)EY) 
(0 VNarQO Vary) 
where E(XY)= f*5, [xy f x, y) dxd y. Find p for X and Y as in Example 3.18. 
(Note: The quantity E(XY) — (E XY(EY ) is called the covariance of X and Y.) 


8. In Example 3.17 would the answer change if the interval (0, 100) is used instead of (0, 1)? 
Explain. 


4 Line and Surface Integrals 


4.1 Line Integrals 


In single-variable calculus you learned how to integrate a real-valued function f'(x) over an 
interval [a,b] in Rt. This integral (usually called a Riemann integral) can be thought of as 
an integral over a path in Rl, since an interval (or collection of intervals) is really the only 
kind of “path” in R!. You may also recall that if f (x) represented the force applied along the 
x-axis to an object at position x in [a,b], then the work W done in moving that object from 
position x = a to x = b was defined as the integral: 


b 
W E f(x)dx 


In this section, we will see how to define the integral of a function (either real-valued or 
vector-valued) of two variables over a general path (i.e. a curve) in R2. This definition will 
be motivated by the physical notion of work. We will begin with real-valued functions of two 
variables. 

In physics, the intuitive idea of work is that 


Work = Force x Distance . 


Suppose that we want to find the total amount W of work done in moving an object along a 
curve C in R? with a smooth parametrization x = x(t), y = y(t), a < t < b, with a force f(x, y) 
which varies with the position (x, y) of the object and is applied in the direction of motion 
along C (see Figure 4.1.1 below). 


0 
Figure 4.1.1 Curve C :x =x(t),y = y(t) for t in [a,b] 


We will assume for now that the function f(x, y) is continuous and real-valued, so we only 
consider the magnitude of the force. Partition the interval [a, b] as follows: 


a-ty«tu «to « «t, ,«t,- b, for some integer n 22 
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As we can see from Figure 4.1.1, over a typical subinterval [¢;,¢;,,] the distance As; traveled 


along the curve is approximately |/ Ax;? + ^y;?, by the Pythagorean Theorem. Thus, if the 
subinterval is small enough then the work done in moving the object along that piece of the 


curve is approximately 
Force x Distance = f(x;., yi.) V Ax;2 + Ay? , (4.1) 


where (x;,, Yis) = (x(t;*), y(t;*)) for some £;* in [¢;,¢;,,], and so 


n-1 
Ws fx, Yin) Ax;? + Ay? (4.2) 
i-0 


is approximately the total amount of work done over the entire curve. But since 


^ 
V Ax? + Ay, - (= J «(uy At, , 


where At; = t; — t;, then 


2 
W D» y EI [x At, . (4.3) 


Taking the limit of that sum as the length of the largest subinterval goes to 0, the sum over 
all subintervals becomes the integral from t =a to t — b, As 7 and na i become x'(£) and y'(t), 
respectively, and f (x;., y;.) becomes f (x(t), y(t)), so that 


b 
- f f GO, y() / x C + yO? di . (4.4) 


The integral on the right side of the above equation gives us our idea of how to define, 
for any real-valued function f(x, y), the integral of f(x, y) along the curve C, called a line 
integral: 


Definition 4.1. For a real-valued function f(x, y) and a curve C in R?, parametrized by 
x= x(t), y = y(t), a <t <b, the line integral of f(x, y) along C with respect to arc length 


sis 
b 
i f(x,y)ds = f f (x(t), y(t) y x t+ y (t? dt . (4.5) 


The symbol ds is the differential of the arc length function 


t 
s = s(t) = f V x'(u + y'(uP du, (4.6) 
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which you may recognize from Section 1.9 as the length of the curve C over the interval [a, t], 


for all ¢ in [a,b]. That is, 
ds = s'(t)dt = y xt - y'(t)? dt, (4.7) 


by the Fundamental Theorem of Calculus. 

For a general real-valued function f(x,y), what does the line integral fo f(x,y)ds rep- 
resent? The preceding discussion of ds gives us a clue. You can think of differentials as 
infinitesimal lengths. So if you think of f(x, y) as the height of a picket fence along C, then 
f (x,y)ds can be thought of as approximately the area of a section of that fence over some 
infinitesimally small section of the curve, and thus the line integral fc f(x, y)ds is the total 
area of that picket fence (see Figure 4.1.2). 


x 


> 


0 
Figure 4.1.2 Area of shaded rectangle = height x width = f(x, y)ds 


Example 4.1. Use a line integral to show that the lateral surface area A of a right circular 
cylinder of radius r and height A is 2zrh. 


Solution: We will use the right circular cylinder with base circle C P 
given by x? + y? = r? and with height A in the positive z direction 
(see Figure 4.1.3). Parametrize C as follows: 


x = x(t) 2 rcost, y = yt) » rsint, O<t<27 = f(x,y) 


Let f(x, y)=A for all (x, y). Then 
0 


b = 2.5459 4:3 
A= , d il t), y(t '(£)2 '(t)2 dt X Cix*t+y*=r 
[feo s | FOOI y +y) 


Figure 4.1.3 


27 
f hvy (—r sint? + (rcost? dt 
0 
27 
n [ r V sin?t+cos2tdt 
0 


27 
rh f ldt = 2arh 
0 


II 
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Note in Example 4.1 that if we had traversed the circle C twice, i.e. let t£ vary from 0 to 
47, then we would have gotten an area of 4zr, i.e. twice the desired area, even though the 
curve itself is still the same (namely, a circle of radius r). Also, notice that we traversed the 
circle in the counter-clockwise direction. If we had gone in the clockwise direction, using the 
parametrization 


x = x(t) = rcosQz-t), y = yt) = rsin2z-t), O<t<2z, (4.8) 


then it is easy to verify (see Exercise 12) that the value of the line integral is unchanged. 

In general, it can be shown (see Exercise 15) that reversing the direction in which a curve 
C is traversed leaves fo f (x, y) ds unchanged, for any f(x,y). If a curve C has a parametriza- 
tion x = x(t), y = y(t), a < t < b, then denote by —C the same curve as C but traversed in the 
opposite direction. Then —C is parametrized by 


x = x(a*b-t), y= ylat+b-t), ast<b, (4.9) 


and we have 


[ fends =| f(x, y)ds. (4.10) 
C -C 


Notice that our definition of the line integral was with respect to the arc length parameter 
s. We can also define 


b 
I f(x, y)dx = f f (x(t), yx (tdt (4.11) 


as the line integral of f (x, y) along C with respect to x, and 


b 
[fe a» x f (x(t), yt) y (dt (4.12) 


as the line integral of f (x, y) along C with respect to y. 

In the derivation of the formula for a line integral, we used the idea of work as force 
multiplied by distance. However, we know that force is actually a vector. So it would be 
helpful to develop a vector form for a line integral. For this, suppose that we have a function 
f(x, y) defined on R? by 


f(x,y) = P(x,y)i + Q(x,y)j 
for some continuous real-valued functions P(x,y) and Q(x, y) on R?. Such a function f is 


called a vector field on R. It is defined at points in R?, and its values are vectors in R2. For 
a curve C with a smooth parametrization x = x(t), y= y(t), a <t <b), let 


r(t) = x(t)i + yj 
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be the position vector for a point (x(t), y(t)) on C. Then r'(t) = x'(t)i- y'(2)j and so 


b b 
[Pe nds + [Renay af P(x(t), (t) x'(t)dt +f Q(x(t), y(t) y(t) dt 
b 
= f (P(x(t), YED (t) + QGGD, y(£) y(t) dt 
b 
=| f(x(t), yt) -r (tdt 


by definition of f(x, y). Notice that the function f(x(t), y(t))-r'(t) is a real-valued function on 
[a,b], so the last integral on the right looks somewhat similar to our earlier definition of a 
line integral. This leads us to the following definition: 


Definition 4.2. For a vector field f(x, y) = P(x, y)i+ Q(x, y)j and a curve C with a smooth 
parametrization x = x(t), y = y(t), a < t x b, the line integral of f along C is 


[te = f Pyas + [ 6.4» (4.13) 
c C c 


b 
= f O a, (4.14) 


where r(t) = x(t)i+ y(t)j is the position vector for points on C. 


We use the notation dr = r'(t)dt = dxi- d yj to denote the differential of the vector-valued 
function r. The line integral in Definition 4.2 is often called a line integral of a vector field 
to distinguish it from the line integral in Definition 4.1 which is called a line integral of a 
scalar field. For convenience we will often write 


[ Picus [ eid [ PG st OG sds. 


where it is understood that the line integral along C is being applied to both P and Q. The 
quantity P(x, y)dx + Q(x, y) d y is known as a differential form. For a real-valued function 
F(x,y), the differential of F is dF = op dx+ x dy. A differential form P(x, y)dx - Q(x, y)dy 
is called exact if it equals dF for some function F(x, y). 

Recall that if the points on a curve C have position vector r(t) = x(t)i+ y(t)j, then r'(t)is a 
tangent vector to C at the point (x(t), y(£)) in the direction of increasing t (which we call the 
direction of C). Since C is a smooth curve, then r'(7) 4 0 on [a,b] and hence 


r'(t) 


T(t) = ——— 
© = Teoj 


is the unit tangent vector to C at (x(t), y(t)). Putting Definitions 4.1 and 4.2 together we get 
the following theorem: 
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Theorem 4.1. For a vector field f(x, y) = P(x, y)i+ Q(x,y)j and a curve C with a smooth 
parametrization x = x(t), y = y(t), a € t < b and position vector r(t) = x(t)i+ y(t)j, 


[te = f £-Tas, (4.15) 
C C 


where T(t) = mo is the unit tangent vector to C at (x(t), y(t)). 


lr’ 


r 


If the vector field f(x, y) represents the force moving an object along a curve C, then the work 
W done by this force is 


W = f £-Tas = [ tar. (4.16) 
C C 


Example 4.2. Evaluate Ja + y23)dx +2xy dy, where: 
(a) C:x=t, y=2t, O<t<1 


(b C:x=t, y=2t?, O<t<1 


Solution: Figure 4.1.4 shows both curves. tY (1,2) 
(a) Since x'(t)= 1 and y'(t) = 2, then 


1 
Í (x? + y*)dx+2xydy = f (E + yP E) + Qxe(t)y(t) y (0) dt 
C 0 


1 
= f ((e2 + 4X1) + 24(24)(2)) dt of 1 
0 


1 Figure 4.1.4 
- f 13t? dt 
0 


_ 1328)" 


3 


13 


0 3 


(b) Since x'(t)= 1 and y'(t) = 4t, then 
1 
Í (x? + y")dx+2xydy = f (E + y(t)?)x"(t) + 2xe(t) y(t) y (£)) dt 
C 0 


1 
- T (E? + 4¢4)(1) + 2t(227)(4t)) dt 
0 


1 
f (£? + 2015) dt 
0 
3 1 


13 
E 4 At? 
3 


1 
=-+4= — 
3 3 


0 
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So in both cases, if the vector field f(x, y) = (x? + y2)i-- 2x yj represents the force moving an 
object from (0,0) to (1,2) along the given curve C, then the work done is B, This may lead 
you to think that work (and more generally, the line integral of a vector field) is independent 
of the path taken. However, as we will see in the next section, this is not always the case. 


Although we defined line integrals over a single smooth curve, if C is a piecewise smooth 
curve, that is 
C-C,uC,u...uC, 


is the union of smooth curves C,,...,C,,, then we can define 


[tar = f fdr, + | fdr, +...+ | f-dr, 
C Cy C2 C, 


where each r; is the position vector of the curve C;. 
Example 4.3. Evaluate Jot + y?)dx - 2xyd y, where C is the polygonal path from (0,0) to 
(0,2) to (1,2). 


Solution: Write C = C, U C}, where C, is the curve given by x 20, y - t, 
0 <t<2 and C, is the curve given by x t, y= 2, 0 < t < 1 (see Figure 
4.1.5). Then 


[2 +9 dx+20ydy =a (x? + y*)dx+2xydy 
C Ci 


+ Í (x2 + y?)dx - 2xydy 
C2 


Figure 4.1.5 


2 1 
= f («02 + ¢7)(0) + 2(0)4(1)) dt + Í ((¢? + 4)(1) + 2t(2X0)) dt 
0 0 


2 1 
- Í odt- | (£2 +4)dt 
0 0 
3 1 
13 
= P +t = -+4= — 
3 b 3 


Line integral notation varies quite a bit. For example, in physics it is common to see the 
notation f. Y f- dl, where it is understood that the limits of integration a and b are for the 
underlying parameter £ of the curve, and the letter 1 signifies length. Also, the formulation 
fcf: 'Tds from Theorem 4.1 is often preferred in physics since it emphasizes the idea of 
integrating the tangential component f- T of f in the direction of T (i.e. in the direction of C), 
which is a useful physical interpretation of line integrals. 
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A 


For Exercises 1-4, calculate fo f (x, y) ds for the given function f(x, y) and curve C. 


1. f(x,y) » xy; C:x=cost, y= sint, 0< t < z/2 


x 
2. f(x, y) - —5—; 
[ONE a 


3. f(x,y)=2x+y; C: polygonal path from (0,0) to (3,0) to (3,2) 


C:x=t,y=0,0<t<1 


4. f(x,y)=x+y?; C: path from (2,0) counterclockwise along the circle x? + y? = 4 to the 
point (—2,0) and then back to (2,0) along the x-axis 


5. Use a line integral to find the lateral surface area of the part of the cylinder 
x? + y? = 4 below the plane x+ 2y + z = 6 and above the xy-plane. 


For Exercises 6-11, calculate fof: dr for the given vector field f(x, y) and curve C. 
6. f(x,y)=i-j; C:x=3t, y=2t,05t<1 

7. f(x,y)=yi-xj; C:x=cost, y=sint,0<t<2z 

8. f(x,y)=xi+yj; C:x=cost, y=sint,0<t<27 

9. f(x,y) =(«?-y)it+(x—- y”)j; C:x=cost, y= sint, 0 < t< 27 

10. fx,y) 2xy?i-xy?j; C: the polygonal path from (0,0) to (1,0) to (0,1) to (0,0) 
11. fx,y) 2(x?- y2)i; C:x=2+cost, y 2 sint, 0t 2z 

B 


12. Verify that the value of the line integral in Example 4.1 is unchanged when using the 
parametrization of the circle C given in formulas (4.8). 


13. Show that if f L r’(t) at each point r(t) along a smooth curve C, then fcf-dr — 0. 


14. Show that if f points in the same direction as r'(£) at each point r(t) along a smooth 
curve C, then fof-dr- follfl ds. 


C 
15. Prove that fo f(x, y)ds = Jc f (x,y)ds. (Hint: Use formulas (4.9).) 


16. Let C be a smooth curve with arc length L, and suppose that f(x, y) = P(x, y)i+ Q(x, y)j 
is a vector field such that ||f(x, y)|| < M for all (x, y) on C. Show that 
| fc f: dv| < ML. (Hint: Recall that |J? g(x)dx|< MEOLA: for Riemann integrals.) 


17. Prove that the Riemann integral f E f(x)dx is a special case of a line integral. 
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4.2 Properties of Line Integrals 


We know from the previous section that for line integrals of real-valued functions (scalar 
fields), reversing the direction in which the integral is taken along a curve does not change 
the value of the line integral: 


Í Ksydas f faas (4.7) 
C =0 


For line integrals of vector fields, however, the value does change. To see this, let f(x, y) = 
P(x, y)it+ Q(x, y)j be a vector field, with P and Q continuously differentiable functions. Let 
C be a smooth curve parametrized by x = x(t), y = y(t), a < t < b, with position vector r(t) = 
x(t)i+ y(t)j (we will usually abbreviate this by saying that C : r(t) = x(t)i+ y(t)j is a smooth 
curve). We know that the curve —C traversed in the opposite direction is parametrized by 
x=x(a+b-t), y=ylat+b-t),a<t<b. Then 


b 
f P(x,ydx = | Pala eb - 0, ya b - 0) Ga b - dt 
-C a 
b 
=- f P(x(a+b—-12), yla 4 b - t) (-x'(a - b — t) dt (by the Chain Rule) 


= [ Pew, xwn-x'wr-du) (by letting u=a+b-t) 


f PUG) ye wae 


b t 
-[ P(x(u), y(u))x'(u)du , since f --[ , So 
f P(x,y)dx = -f P(x,y)dx 

-C C 


since we are just using a different letter (u) for the line integral along C. A similar argument 
shows that 


f QU y)dy.s = Í AET 
=C C 


and hence 


[ tar= | P(x,y)dx+ | Q(x, y)dy 
-C -C -C 


-Í P(x,y)dx+- | Q(x,y)dy 
C C 


-([ Po, ds | 6.45] 

C C 

-f f-dr. (4.18) 
C 


f f-dr 
-C 
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The above formula can be interpreted in terms of the work done by a force f(x, y) (treated 
as a vector) moving an object along a curve C: the total work performed moving the object 
along C from its initial point to its terminal point, and then back to the initial point moving 
backwards along the same path, is zero. This is because when force is considered as a vector, 
direction is accounted for. 

The preceding discussion shows the importance of always taking the direction of the curve 
into account when using line integrals of vector fields. For this reason, the curves in line 
integrals are sometimes referred to as directed curves or oriented curves. 

Recall that our definition of a line integral required that we have a parametrization x — 
x(t), y = y(t), a < t < b for the curve C. But as we know, any curve has infinitely many 
parametrizations. So could we get a different value for a line integral using some other 
parametrization of C, say, x = X(u), y= y(u), cs u<d ? If so, this would mean that our 
definition is not well-defined. Luckily, it turns out that the value of a line integral of a 
vector field is unchanged as long as the direction of the curve C is preserved by whatever 
parametrization is chosen: 


Theorem 4.2. Let f(x, y) = P(x, y)i+ Q(x, y)j be a vector field, and let C be a smooth curve 
parametrized by x = x(t), y = y(t), a <t b. Suppose that t = a(u) for c < u < d, such that 


a = a(c), b = a(d), and a'(u) » 0 on the open interval (c, d) (i.e. a(u) is strictly increasing on 
[c, d]. Then fc f-dr has the same value for the parametrizations x = x(t), y= y(t), a < t < b 
and x = X(u) = x(a(u)), y = 3(u) = y(a(u)), c xu x d. 


Proof: Since a(u) is strictly increasing and maps [c,d] onto [a,b], then we know that t = 
a(u) has an inverse function u = a~1(t) defined on [a,b] such that c = a^!(a), d = a- (b), 
and qu B Uu Also, dt = a'(u)du, and by the Chain Rule 


a! 


ONCE o- PO 
X (u) = 47 Ju (Qu) "Um T x (t)a (u) > x)= ian 
so making the susbstitution t = a(u) gives 
T 1 ai &'(u) 
f P(x(t), y(t)) x (t)dt = f i P(xlau)), yau) ry (a (udu) 


d 
- f P(&(u),5(u)&' (u)du , 


which shows that Je P(x,y)dx has the same value for both parametrizations. A similar 
argument shows that fo Q(x, y)dy has the same value for both parametrizations, and hence 
Jof: dr has the same value. QED 


Notice that the condition a'(u) > 0 in Theorem 4.2 means that the two parametrizations 
move along C in the same direction. That was not the case with the “reverse” parametriza- 
tion for -C: for u =a +b -t we have t=a(u)=a+b-u>a'(u)=-1<0. 
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Example 4.4. Evaluate the line integral So +y?)dx+?2xydy from Example 4.2, Section 
4.1, along the curve C:x = t, y = 2t?, 0€ t < 1, where t = sinu for 0 < u < 7/2. 


Solution: First, we notice that 0 = sin0, 1 = sin(z/2), and gt = cosu > 0 on (0,7/2). So by 
Theorem 4.2 we know that if C is parametrized by 


x-sinu, y-2sin?u , O0<usa/2 


then Jo? +y?)dx+2xydy should have the same value as we found in Example 4.2, namely 
B, And we can indeed verify this: 


z/2 
Í (x? + y)dx +2xydy = Í ((sin? u + (2sin? uP)cosu + 2(sinu)(2sin? u)4sinu cos u)du 
C 0 


n/2 
= f (sin? u + 20sin* u)cosu du 
0 


sin® u He 
= t 4sin?u 
3 0 
1 13 
= .=+4= — 
3 3 


In other words, the line integral is unchanged whether t or u is the parameter for C. 


By a closed curve, we mean a curve C whose initial point and terminal point are the 
same, i.e. for C : x = x(t), y= y(t), a < t < b, we have (x(a), y(a)) = (x(b), y(b)). 


C C 
(a) Closed (b) Not closed 


Figure 4.2.1 Closed vs nonclosed curves 
A simple closed curve is a closed curve which does not intersect itself. Note that any 


closed curve can be regarded as a union of simple closed curves (think of the loops in a figure 
eight). We use the special notation 


j.re nas and jte 
C C 


to denote line integrals of scalar and vector fields, respectively, along closed curves. In some 
older texts you may see the notation f or (p to indicate a line integral traversing a closed 


curve in a counterclockwise or clockwise direction, respectively. 
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So far, the examples we have seen of line integrals (e.g. Example 4.2) have had the same 
value for different curves joining the initial point to the terminal point. That is, the line 
integral has been independent of the path joining the two points. As we mentioned before, 
this is not always the case. The following theorem gives a necessary and sufficient condition 
for this path independence: 


Theorem 4.3. In a region R, the line integral fof- dr is independent of the path between 


any two points in R if and only if {,f-dr = 0 for every closed curve C which is contained in 
R. 


Proof: Suppose that f; f-dr = 0 for every closed curve C which is contained in R. Let P, 
and P, be two distinct points in R. Let C, be a curve in R going from P, to P,, and let C, 
be another curve in R going from P, to P,, as in Figure 4.2.2. 


Then C = C,u -C, is a closed curve in R (from P, to C, 
P,), and so fof: dr = 0. Thus, 
0= jte P, P, 
C 
= f-dr + f f-dr 
Cı -C2 C; 
Figure 4.2.2 


= tdr- | f-dr , and so 
Cy C2 

Jc, f-dr= Jc, f-dr. This proves path independence. 
Conversely, suppose that the line integral fọ f-dr is independent of the path between any 

two points in R. Let C be a closed curve contained in R. Let P, and P; be two distinct points 

on C. Let C, be a part of the curve C that goes from P, to P,, and let C, be the remaining 

part of C that goes from P, to P,, again as in Figure 4.2.2. Then by path independence we 

have 


f-dr = f-dr 
C4 Co 
f-dr - f f-dr = 0 
C4 Co 
f-dr + f-dr = 0, so 
Ci -Co 


ae 
p 
à, 
m 
l 
o 


since C=C,U-C,. QED 
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Clearly, the above theorem does not give a practical way to determine path independence, 
since it is impossible to check the line integrals around all possible closed curves in a region. 
What it mostly does is give an idea of the way in which line integrals behave, and how seem- 
ingly unrelated line integrals can be related (in this case, a specific line integral between 
two points and all line integrals around closed curves). 

For a more practical method for determining path independence, we first need a version 
of the Chain Rule for multivariable functions: 


Theorem 4.4. (Chain Rule) If z = f(x, y) is a continuously differentiable function of x and 
y, and both x = x(t) and y = y(t) are differentiable functions of t, then z is a differentiable 
function of t, and 


dz _ ôz dx | Oz dy 
dt  óxdt dydt 


at all points where the derivatives on the right are defined. 


(4.19) 


The proof is virtually identical to the proof of Theorem 2.2 from Section 2.4 (which uses the 
Mean Value Theorem), so we omit it.! We will now use this Chain Rule to prove the following 
sufficient condition for path independence of line integrals: 


Theorem 4.5. Let f(x, y) = P(x, y)i+ Q(x, y)j be a vector field in some region R, with P and 
Q continuously differentiable functions on R. Let C be a smooth curve in R parametrized 
by x = x(t), y = y(t), a <t < b. Suppose that there is a real-valued function F(x, y) such that 
VF =f on R. Then 


Í f-dr = F(B) - F(A), (4.20) 
C 


where A = (x(a), y(a)) and B = (x(b), y(b)) are the endpoints of C. Thus, the line integral is 
independent of the path between its endpoints, since it depends only on the values of F at 
those endpoints. 


Proof: By definition of f; f-dr, we have 


b 
[ fdr = | (Pet ve) 0: QG(. 0€) dt 
b(0F dx OF dy OF OF 
= — — + — — | dt (since VF =f > — =P —= 
l EB a d» EIE (since > ax and ay Q) 
b 
= f F' (x(t), y(t))dt (by the Chain Rule in Theorem 4.4) 
a 
b 
= F(x, y@)| = FG) - F(A) 
by the Fundamental Theorem of Calculus. QED 


1See TAYLOR and MANN, $6.5. 
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Theorem 4.5 can be thought of as the line integral version of the Fundamental Theorem 
of Calculus. A real-valued function F(x, y) such that VF (x, y) = f(x, y) is called a potential 
for f. A conservative vector field is one which has a potential. 


Example 4.5. Recall from Examples 4.2 and 4.3 in Section 4.1 that the line integral fce + 
y?)dx + 2xydy was found to have the value B for three different curves C going from the 
point (0,0) to the point (1,2). Use Theorem 4.5 to show that this line integral is indeed path 


independent. 


Solution: We need to find a real-valued function F(x, y) such that 


Lagay and of gps 

Ox oy 
Suppose that T = x? + y?, Then we must have F(x, y) = ix 4 xy? + g(y) for some function 
g(y). So x = 2xy + g'(y) satisfies the condition a = 2xy if g'(y) 2 0, i.e. g(y) - K, where K 
is a constant. Since any choice for K will do (why?), we pick K = 0. Thus, a potential F(x, y) 
for f(x, y) = (x? + y?)i + 2xyj exists, namely 


1 
F(x,y) = ge tay? ‘ 


Hence the line integral foi? t y?)dx 4 2xydy is path independent. 
Note that we can also verify that the value of the line integral of f along any curve C going 
from (0,0) to (1,2) will always be i, since by Theorem 4.5 

13 


[ tar = F(1,2) - F(0,0) = 18 aye - (040) - ljá =, 
C 3 3 3 


A consequence of Theorem 4.5 in the special case where C is a closed curve, so that the 
endpoints A and B are the same point, is the following important corollary: 


Example 4.6. Evaluate j xdx+ ydy for C: x= 2cost, y z3sint, Oz t 2z. 
C 
Solution: The vector field f(x, y) = xi+ yj has a potential F(x, y): 


OF 1 
— =x > F(x,y) = —x?4g(y) ,S0 
Ox 2 


oF 1 
—=y > g'(y)=y > gly) = =y? +K 
oy 2 
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1 1 
for any constant K, so F(x, y) - 2* + 2 y? is a potential for f(x, y). Thus, 


$ xdx+ydy - fre = 0 
C C 


by Corollary 4.6, since the curve C is closed (it is the ellipse E t a = 1). 


aguan fF v 


C 


; Evaluate $ (1? + y")dix+2xydy for C : x = cost, y = sint, 0 < t < 2z. 
C 


s Evaluate | (x? y dx2xydy for C:x-cost, y sint, 0xtzz. 
C 


. Is there a potential F(x, y) for f(x, y) = y1— xj? If so, find one. 
. Is there a potential F(x, y) for f(x, y) = xi- yj? If so, find one. 


. Is there a potential F(x, y) for f(x, y) = xy?i + x? yj? If so, find one. 


. Let f(x, y) and g(x, y) be vector fields, let a and b be constants, and let C be a curve in R2. 


Show that 
[atsbe)-ar = af f-dr + 3) g'dr. 
C C C 


. Let C be a curve whose arc length is L. Show that fọ 1ds =L. 


. Let f(x,y) and g(x,y) be continuously differentiable real-valued functions in a region R. 


Show that 
févee = -$ gVf:dr 
C C 


for any closed curve C in R. (Hint: Use Exercise 21 in Section 2.4.) 


. Let f(x, y) = => i+ = aj for all (x, y) Z (0,0), and C : x = cost, y = sint, 0 < t < 2s. 


x+y x+y 


(a) Show that f= VF, for F(x, y) = tan7!(y/x). 
(b) Show that j f- dr - 2z. Does this contradict Corollary 4.6? Explain. 
C 


10. Let g(x) and h(y) be differentiable functions, and let f(x, y) = h(y)i+ g(x)j. Can f havea 


potential F(x, y)? If so, find it. You may assume that F would be smooth. (Hint: Consider 
the mixed partial derivatives of F.) 
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4.3 Green's Theorem 


We will now see a way of evaluating the line integral of a smooth vector field around a 
simple closed curve. A vector field f(x, y) = P(x, y)i+ Q(x, y)j is smooth if its component 
functions P(x, y) and Q(x,y) are smooth. We will use Green's Theorem (sometimes called 
Green's Theorem in the plane) to relate the line integral around a closed curve with a double 
integral over the region inside the curve: 


Theorem 4.7. (Green's Theorem) Let R be a region in R? whose boundary is a simple 
closed curve C which is piecewise smooth. Let f(x, y) = P(x, y)i+ Q(x, y)j be a smooth vector 
field defined on both R and C. Then 


0Q OP 
f £-ar = Í (2-5) dA, (4.21) 
C s Ox Ody 


where C is traversed so that R is always on the left side of C. 


Proof: We will prove the theorem in the case for a simple region R, that is, where the 
boundary curve C can be written as C = C, UC, in two distinct ways: 


C, =the curve y = y,(x) from the point X, to the point X, (4.22) 
C, =the curve y = y.(x) from the point X, to the point X;, (4.23) 


where X, and X, are the points on C farthest to the left and right, respectively; and 


C, = the curve x = x,(y) from the point Y, to the point Y, (4.24) 
C, = the curve x = x4(y) from the point Y, to the point Y,, (4.25) 
where Y, and Y, are the lowest and highest points, respectively, on C. See Figure 4.3.1. 
iy 
Mill y = yxx) 
xXx) 


Figure 4.3.1 


Integrate P(x, y) around C using the representation C = C,U C; given by (4.22) and (4.23). 
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Since y = y,(x) along C, (as x goes from a to b) and y = y(x) along C, (as x goes from b to 
Q), as we see from Figure 4.3.1, then we have 


RITE zi P(x,y)dx -f P(x, y)dx 
C Ci C2 


b a 
- f PEOIA D Peed 


b b 
f P(x, y G))dx - f P(x, y Go) da 


b 
z f (Pie uy Panada 


2 (x) 
-f [Pe D| A ) dx 


ya(x) gp 
= -f f = a ———dydx (by the Fundamental Theorem of Calculus) 
yi(x) 


i 
| 
XI 
TE 
a 
> 


Likewise, integrate Q(x, y) around C using the representation C = C, UC, given by (4.24) 
and (4.25). Since x = x,(y) along C, (as y goes from d to c) and x = x,(y) along C, (as y goes 
from c to d), as we see from Figure 4.3.1, then we have 


j Q(x,)dy = Í Ql, y)dy + Í QG,y)dy 
C Cy C» 


c d 
[i Geay f AOE TA 


d d 
- f Q(x(y), dy + Í Gdy 


d 
f (QUY) GEDY 


x ne 


- Í Í Ras i 


x29) g 
-f | 2 y) — — — dxdy (by the Fundamental Theorem of Calculus) 
x1(y) 


x and so 


xi() 
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jte 
C 


f Paast d Q(x, y)dy 
C C 


[Eo [o 
- [8-2] 


QED 


Though we proved Green's Theorem only for a simple region R, the theorem can also be 
proved for more general regions (say, a union of simple regions).? 


Example 4.7. Evaluate $c o? t y?)dx * 2xydy, where C is the boundary (traversed counter- 
clockwise) of the region R = ((x, y): 0€ x < 1, 2x? € y < 2x}. 

Solution: R is the shaded region in Figure 4.3.2. By Green's Theorem, for 4Y (1,2) 
P(x, y) 2 x? + y? and Q(x, y) = 2xy, we have 2 


je +y")dx+2xydy = Wasa) C 
= [Jos-avaa z l zh of 1 


Figure 4.3.2 
We actually already knew that the answer was zero. Recall from Example 4.5 m ocun 
4.2 that the vector field f(x, y) = (x? + y?)i + 2xyj has a potential function F(x, y) = ix? txy?, 
and so f. f: dr =0 by Corollary 4.6. 


Example 4.8. Let f(x, y) = P(x, y)i+ Q(x, y)), where 


-y » 
P ? = EO. o d , = Toye. x 
(x,y) pag n Q(x, y) xi. yi 


and let R = ((x, y) : 0 < x? + y? € 1). For the boundary curve C : x? + y? = 1, traversed counter- 
clockwise, it was shown in Exercise 9(b) in Section 4.2 that f^ f+ dr = 2z. But 


m uetus | eus) = [onn 


This would seem to contradict Green's Theorem. However, note that R is not the entire 
region enclosed by C, since the point (0,0) is not contained in R. That is, R has a “hole” at 
the origin, so Green's Theorem does not apply. 


2See TAYLOR and MANN, $ 15.31 for a discussion of some of the difficulties involved when the boundary curve 
is *complicated". 
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If we modify the region R to be the annulus R = M 
(5,9) : 1/4 € x? + y? < 1} (see Figure 4.3.3), and take 
the “boundary” C of R to be C = CU C, where C, is 
the unit circle x? + y? = 1 traversed counterclockwise 
and C, is the circle x? + y? = 1/4 traversed clockwise, 
then it can be shown (see Exercise 8) that 


jt o. 
C 


We would still have n (2 B 2 dA — 0, so for this R 


we would have 


ô — ðP Figure 4.3.3 The annulus R 
peel easet 


which shows that Green's Theorem holds for the annular region R. 


It turns out that Green's Theorem can be extended to multiply connected regions, that is, 
regions like the annulus in Example 4.8, which have one or more regions cut out from the 
interior, as opposed to discrete points being cut out. For such regions, the “outer” boundary 
and the “inner” boundaries are traversed so that R is always on the left side. 


(a) Region R with one hole (b) Region R with two holes 


Figure 4.3.4 Multiply connected regions 


The intuitive idea for why Green's Theorem holds for multiply connected regions is shown 
in Figure 4.3.4 above. The idea is to cut “slits” between the boundaries of a multiply con- 
nected region R so that R is divided into subregions which do not have any “holes”. For 
example, in Figure 4.3.4(a) the region R is the union of the regions R, and R,, which are 
divided by the slits indicated by the dashed lines. Those slits are part of the boundary of 
both R, and R,, and we traverse then in the manner indicated by the arrows. Notice that 
along each slit the boundary of R, is traversed in the opposite direction as that of R,, which 
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means that the line integrals of f along those slits cancel each other out. Since R, and R, do 
not have holes in them, then Green's Theorem holds in each subregion, so that 


fy toe = [US n od fg tae- ff (2-Z) a 


of Ry 


But since the line integrals along the slits cancel out, we have 


f-dr = j f-dr «d f-dr, 
b bdy bdy 


of Ry of Ro 


and so 


a ae og) dl Ue oy asp) 


which shows that Green’s Theorem holds in the region R. A similar argument shows that 
the theorem holds in the region with two holes shown in Figure 4.3.4(b). 

We know from Corollary 4.6 that when a smooth vector field f(x, y) = P(x, y)i+ Q(x, y)j on 

a region R (whose boundary is a piecewise smooth, simple closed curve C) has a potential in 

R, then $c f-dr - 0. And if the potential F(x, y) is smooth in R, then a =P and a =Q, and 

so we know that 

Or oF ôP OQ. 

- > — in R. 

OyOx  OxOy ðy Ox 


Conversely, if Li = on in R then 


f tdr = [ae Tjaa = [uas =0. 


For a simply connected region R (i.e. a region with no holes), the following can be shown: 


The following statements are equivalent for a simply connected region R in R?: 


(a) f(x,y) = P(x,y)i* Q(x, y)j has a smooth potential F(x, y) in R 


(b) Í f- dr is independent of the path for any curve C in R 
C 


(c) j f-dr = 0 for every simple closed curve C in R 
C 


OP ð 
(d) j —= ~= in R (in this case, the differential form P dx +Q dy is exact) 
x 
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A 


For Exercises 1-4, use Green's Theorem to evaluate the given line integral around the curve 
C, traversed counterclockwise. 


1. fe -ydr +2xydy; C is the boundary of R = {(x,y):0< x < 1, 2x? < y < 2x} 
C 


2. j x?^ydx * 2xydy; C is the boundary of R = {(x,y):0<x<1, x? < y < x) 
C 


wo 


5 j 2ydx —3xdy; C is the circle x? + y? 2 1 
C 


(e + y*)dx + (e” + x) dy; C is the boundary of the triangle with vertices (0,0), (4,0) 
C 
and (0, 4) 


» 


5. Is there a potential F(x, y) for f(x, y) = (y? + 3x?)i + 2xyj? If so, find one. 


6. Is there a potential F(x, y) for f(x, y) = (x? cos(xy) + 2xsin(xy))i+ x2ycos(xy)j? If so, find 
one. 


7. Is there a potential F(x, y) for f(x, y) = (8xy + 3)i+ A(x? + y)j? If so, find one. 


8. Show that for any constants a, b and any closed simple curve C, j adx+bdy=0. 
C 


9. For the vector field f as in Example 4.8, show directly that $c f-dr = 0, where C is the 
boundary of the annulus R = ((x, y) : 1/4 < x? + y? < 1} traversed so that R is always on 
the left. 


10. Evaluate j e” sinydx+( y? +e” cos y) d y, where C is the boundary of the rectangle with 


vertices (1, — 1), (1,1), (- 1, 1) and (-1,— 1), traversed counterclockwise. 
C 


11. For a region R bounded by a simple closed curve C, show that the area A of R is 


1 
A= -$ yds = f sdy = sp xdy-yde, 
C d 2 Jc 


where C is traversed so that R is always on the left. (Hint: Use Green's Theorem and the 
fact that A= ff 14A.) 
R 
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4.4 Surface Integrals and the Divergence Theorem 


In Section 4.1 we learned how to integrate along a curve. We will now learn how to perform 
integration over a surface in R?, such as a sphere or a paraboloid. Recall from Section 1.8 
how we identified points (x, y, z) on a curve C in R3, parametrized by x = x(t), y = y(t), z = z(t), 
a<t<b, with the terminal points of the position vector 


r(¢) 2 x(t)i+ y(t)j + z(£)k for t in [a,b]. 


The idea behind a parametrization of a curve is that it “transforms” a subset of R! (nor- 
mally an interval [a,b]) into a curve in R? or R? (see Figure 4.4.1). 


(x(t), y(t), z(£)) 


(x(b), y(b), z(b)) 


EX 


Figure 4.4.1 Parametrization of a curve C in R® 


Similar to how we used a parametrization of a curve to define the line integral along the 
curve, we will use a parametrization of a surface to define a surface integral. We will use 
two variables, u and v, to parametrize a surface È in R3: x =x(u,v), y = y(u,v), z = z(u,v), 
for (u,v) in some region R in R? (see Figure 4.4.2). 


Av R? 
AZ 
2 
PN 
R x =x(u,v) 
* y= y(u,v) 
(uv) z — z(u,v) r(u,v) 
y 
(0) 
u x 


Figure 4.4.2 Parametrization of a surface X in R® 


In this case, the position vector of a point on the surface X is given by the vector-valued 
function 
r(u,v) = x(u,v)i + y(u,v)j + z(u,v)k for (u,v) in R. 
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Since r(u,v) is a function of two variables, define the partial derivatives or and or for 
(u,v) in R by 


a a a 
(u,v) = Zlu, vi + Zu, vj + u,v)k, and 
u ðu ðu Ou 
ô ô a 
(u,v) = P Qu, v) + 2 (ui, v)j + Z (u,v)k . 
Ov Ov Ov 


The parametrization of X can be thought of as “transforming” a region in R? (in the uv- 
plane) into a 2-dimensional surface in R?. This parametrization of the surface is sometimes 
called a patch, based on the idea of “patching” the region R onto X in the grid-like manner 
shown in Figure 4.4.2. 

In fact, those gridlines in R lead us to how we will define a surface integral over X. Along 
the vertical gridlines in R, the variable u is constant. So those lines get mapped to curves on 
X, and the variable u is constant along the position vector r(u,v). Thus, the tangent vector 
to those curves at a point (u,v) is a Similarly, the horizontal gridlines in R get mapped to 
curves on È whose tangent vectors are o. 

Now take a point (u,v) in R as, say, the lower left corner of one of the rectangular grid 
sections in R, as shown in Figure 4.4.2. Suppose that this rectangle has a small width 
and height of Au and Av, respectively. The corner points of that rectangle are (u,v), (u + 
Au,v), (u + Au,v + Av) and (u,v + ^v). So the area of that rectangle is A = Au Av. Then that 
rectangle gets mapped by the parametrization onto some section of the surface X which, 
for Au and Av small enough, will have a surface area (call it do) that is very close to the 
area of the parallelogram which has adjacent sides r(u + Au,v) — x(u,v) (corresponding to the 
line segment from (u,v) to (u + ^u,v) in R) and r(u,v + Av) — r(u,v) (corresponding to the 
line segment from (u,v) to (u,v + ^v) in R). But by combining our usual notion of a partial 
derivative (see Definition 2.3 in Section 2.2) with that of the derivative of a vector-valued 
function (see Definition 1.12 in Section 1.8) applied to a function of two variables, we have 


or r(u + ^u,v) - r(u,v) 


— z ——————— ————— , and 
Ou Au 

dr — r(u,v * Av) - r(u,v) 

av — Av , 


and so the surface area element do is approximately 


Or or 


— x — || Au Av 
Ou Ov 


|| Gru + Au, v) -x(u,v)) x (u,v + ^v) -r(u,v))| = | ( 


by Theorem 1.13 in e 1.4. Thus, the total surface area S of È is approximately the sum 
of all the quantities E 2r x à E = || Au Av, summed over the rectangles in R. Taking the limit of 
that sum as the diagonal of the largest rectangle goes to 0 gives 


s - ar 


a 
Pa tea ys (4.26) 


ðv 
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We will write the double integral on the right using the special notation 


[e-f 


2 R 


ôr ôr 
x — 


— ; 4.27 
ðu Ov uu ) 


This is a special case of a surface integral over the surface X, where the surface area element 
do can be thought of as 1do. Replacing 1 by a general real-valued function f(x,y,z) defined 
in R?, we have the following: 


Definition 4.3. Let X be a surface in R? parametrized by x = x(u,v), y = y(u,v), 

z = z(u,v), for (u,v) in some region R in R2. Let r(u,v) = x(u,v)i+ y(u,v)j + z(u,v)k be the 
position vector for any point on È, and let f(x,y,z) be a real-valued function defined on some 
subset of R? that contains X. The surface integral of f(x, y,z) over X is 


Í f(x,y,z)da = || f (x(u,v), y(u,v), z(u,v)) eS | dud. (4.28) 
Ou Ov 


p» R 


In particular, the surface area S of È is 


ZI 


Example 4.9. A torus T is a surface obtained by revolving a circle of radius a in the yz-plane 
around the z-axis, where the circle’s center is at a distance b from the z-axis (0 « a < b), as 
in Figure 4.4.3. Find the surface area of T. 


(y - b? +27 =a? 


Ya 


i* b " 
(a) Circle in the yz-plane (b) Torus T 


Figure 4.4.3 
Solution: For any point on the circle, the line segment from the center of the circle to that 


point makes an angle u with the y-axis in the positive y direction (see Figure 4.4.3(a)). And 
as the circle revolves around the z-axis, the line segment from the origin to the center of that 
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circle sweeps out an angle v with the positive x-axis (see Figure 4.4.3(b)). Thus, the torus 
can be parametrized as: 


x=(b+acosu)cosu, y=(b+acosu)sinvu, z=asinu, O<u<27, Ozxvz2m 
So for the position vector 


r(u,v) = x(u,v)i + y(u,v)j + z(u,v)k 


(b+acosu)cosvi + (b+acosu)sinvj + asinuk 


we see that 


or f . ; NC 

gu ^ 8inucosvi — asinu sinvj + acosuk 

u 

or "EM ; 

ros —(b+acosu)sinvi + (b+acosu)cosvj + 0k, 
U 


and so computing the cross product gives 


Or or 
22^ aus —a(b - acosu)cosv cosui — a(b +acosu)sinv cosuj — a(b+acosu)sinuk , 
u Ov 
which has magnitude 
ôr | or aap ) 
ox ase a acosu). 


Thus, the surface area of T is 


S= Jf ec 
X 
-FTIE 

2m p2n 

=a) I a(b -acosu)dudv 
0 Jo 
27 u-2n 

- [abu +a?sinu| Jav 
0 u=0 


27 
f 2zab dv 
0 


An?ab 


Ó 
Tx dudv 


Since 2 Lo and & 7 are tangent to the surface X (i.e. liein the tangent plane to X at each point 
on È), then their cross product or x & i 


at each point of X. Thus, 


is perpendicular to the tangent plane to the surface 
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[| (e».20- [| festa zt omia 
2 R 


where n= oe x a We say that n is a normal vector to È. 


Recall that normal vectors to a plane can point in two opposite 
directions. By an outward unit normal vector to a surface È, 
we will mean the unit vector that is normal to X and points away 
from the “top” (or “outer” part) of the surface. This is a hazy 
definition, but the picture in Figure 4.4.4 gives a better idea of 
what outward normal vectors look like, in the case of a sphere. 
With this idea in mind, we make the following definition of a 
surface integral of a 3-dimensional vector field over a surface: 


x 
Figure 4.4.4 


Definition 4.4. Let X be a surface in R? and let f(x, y,z) = f. (x, y, z)i + folx, y, 2j + fac, y, Zk 
be a vector field defined on some subset of R? that contains X. The surface integral of f 
over È is 


[| #20 - [| #220 ; (4.30) 
X 


2 


where, at any point on È, n is the outward unit normal vector to È. 


Note in the above definition that the dot product inside the integral on the right is a 
real-valued function, and hence we can use Definition 4.3 to evaluate the integral. 


Example 4.10. Evaluate the surface integral [f f-do, where f(x, y, z) = yzi+xzj+xyk and X 


is the part of the plane x+ y -z 2 1 with x 2 0, y 2 0, and z = 0, with the outward unit normal 
n pointing in the positive z direction (see Figure 4.4.5). 


Solution: Since the vector v = (1,1, 1) is normal to the plane x - y+z=1 
(why?), then dividing v by its length yields the outward unit normal 


vector n — J We now need to parametrize X. As we can see X 


1 1 1 
from Figure 4.4.5, projecting X onto the xy-plane yields a triangular 


region R = {(x,y):0<x<1, 0<y<1-x}. Thus, using (u,v) instead of | i 
xtytz- 

(x, y), we see that A 
Figure 4.4.5 


x=u, y=v, z=1-(u+v), forO<u<1,0sv<l-u 


4.4 Surface Integrals and the Divergence Theorem 161 


is a parametrization of È over R (since z = 1— (x+ y) on È). So on È, 


f-n = (yz,xz,x [= ES E = ES z+xz+xy) 
E ye, > y V3 V3 V3 = ua y 
= let ye tay) = UHA- u+) uo) 


ae +v)-(u +v)? +uv) 


V3 
for (u,v) in R, and for r(u,v) = x(u,v)i + y(u,v)j + z(u,v)k = ui vj - (1- (u +v))k we have 


Or or 
—x—|-v3. 
Ou Ov 


Or or 
— xx — «= (1,0, -1) x (0,1, -1) zz (1,1,1) > 
Ou Ov 


Thus, integrating over R using vertical slices (e.g. as indicated by the dashed line in Figure 


4.4.5) gives 
ZAT 
5 


= 


dudu 


—— — 


Or or 
Ou Ov 


- f| e. ats oom 
R 


1 pl-u 
— f f e usto EN dedi 
o Jo v3 


f [ez (u+v)? uv? d 

- - T—— du 

0 2 3 2 |j-0 
INE u 3u? e] 

- =+ —-— + — | du 
0 \6 2 2 6 

. uu? a But |* 1 

6 4 2 2 |, 8° 


Computing surface integrals can often be tedious, especially when the formula for the 
outward unit normal vector at each point of X changes. The following theorem provides an 
easier way in the case when È is a closed surface, that is, when X encloses a bounded 
solid in R?. For example, spheres, cubes, and ellipsoids are closed surfaces, but planes and 
paraboloids are not. 
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Theorem 4.8. (Divergence Theorem) Let X be a closed surface in R? which bounds a 
solid S, and let f(x, y, z) = f,(x, y, z)i+ f(x, y, z)j + fs(x, y, z)k be a vector field defined on some 
subset of R? that contains X. Then 


[| a» zi divfdV, (4.31) 


2 S 


nap fı fz ôf 
div f = ax Sun TE 


is called the divergence of f. 


The proof of the Divergence Theorem is very similar to the proof of Green's Theorem, i.e. it 
is first proved for the simple case when the solid S is bounded above by one surface, bounded 
below by another surface, and bounded laterally by one or more surfaces. The proof can then 
be extended to more general solids.? 


Example 4.11. Evaluate [ff:do, where f(x,y,z) = xi^ yj * zk and X is the unit sphere 
x 

x+y +z — 1. 

Solution: We see that div f=1+1+1=83, so 


Í f-do = Je = je 


> 
3 
JE dV = 3vol(S) = 3. X... an 
S 


| 


3 


In physical applications, the surface integral ff f-do is often referred to as the flux of f 


through the surface X. For example, if f epresents the velocity field of a fluid, then the flux 
is the net quantity of fluid to flow through the surface È per unit time. A positive flux means 
there is a net flow out of the surface (i.e. in the direction of the outward unit normal vector 
n), while a negative flux indicates a net flow inward (in the direction of —n). 

The term divergence comes from interpreting div f as a measure of how much a vector 
field “diverges” from a point. This is best seen by using another definition of div f which is 
equivalent* to the definition given by formula (4.32). Namely, for a point (x, y,z) in R3, 


, a ae 
div f(x,y,z) = kim = ffe do, (4.33) 
X 


3See TAYLOR and MANN, $ 15.6 for the details. 
4See SCHEY, p. 96-39, for an intuitive discussion of this. 
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where V is the volume enclosed by a closed surface X around the point (x,y,z). In the 
limit, V — 0 means that we take smaller and smaller closed surfaces around (x,y,z), which 
means that the volumes they enclose are going to zero. It can be shown that this limit is 
independent of the shapes of those surfaces. Notice that the limit being taken is of the 
ratio of the flux through a surface to the volume enclosed by that surface, which gives a 
rough measure of the flow “leaving” a point, as we mentioned. Vector fields which have zero 
divergence are often called solenoidal fields. 
The following theorem is a simple consequence of formula (4.33). 


Theorem 4.9. If the flux of a vector field f is zero through every closed surface containing a 


given point, then div f 2 0 at that point. 


Proof: By formula (4.33), at the given point (x,y,z) we have 


div f(x, y,z) 


1 
jim V Í Il f-do for closed surfaces È containing (x,y,z), so 
X 


1 
lm V (0) by our assumption that the flux through each È is zero, so 


II 
© 


QED 


Lastly, we note that sometimes the notation 


fp roiv nae and fpt-do 
X X 


is used to denote surface integrals of scalar and vector fields, respectively, over closed sur- 


faces. Especially in physics texts, it is common to see simply $ instead of ff. 
X X 


D. Exercises 1-4, use the Divergence Theorem to evaluate the surface integral ff f-do of 
the given vector field f(x, y, z) over the surface È. I 

1. f(x,y,2) = xi - 2yj + 3zk, Z:x? 4 y? - 2229 

2. f(x, y,z)=xi+ yj + zk, X: boundary of the solid cube S = ((x,y,2):0 x,y,z 1) 

3. f(x,y,z) 2 x3i + y?j e z2k, Z:x? y? «22 21 


4. f(x, y,2) = 2i - 3j - 5k, Z:x? y? e 22-1 
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5. Show that the flux of any constant vector field through any closed surface is zero. 


6. Evaluate the surface integral from Exercise 2 without using the Divergence Theorem, i.e. 
using only Definition 4.3, as in Example 4.10. Note that there will be a different outward 
unit normal vector to each of the six faces of the cube. 


7. Evaluate the surface integral ff f- do, where f(x, y,z)=x?i+xyj+zk and X is the part of 


X 
the plane 6x+ 3y+ 22 = 6 with x 2 0, y 2 0, and z 2 0, with the outward unit normal n 
pointing in the positive z direction. 


8. Use a surface integral to show that the surface area of a sphere of radius r is 4zr?. (Hint: 
Use spherical coordinates to parametrize the sphere.) 


9. Use a surface integral to show that the surface area of a right circular cone of radius R 
and height h is nR v A? + R?. (Hint: Use the parametrization x = rcos0, y 2 rsin0, z = Èr, 
forO<r<R and 0<90< 2r.) 


2 
10. The ellipsoid 5 + 7 + £ = 1 can be parametrized using ellipsoidal coordinates 


x-asin$cos0, y = bsinġ sin0 , z =ccosġ, for0x0x2zand0zozzm. 


Show that the surface area S of the ellipsoid is 


z p2n 
S = f f sin 9 V a2b? cos? $ + c?(a? sin? 0 + b? cos?0)sin? p dO do . 
0 Jo 


(Note: The above double integral can not be evaluated by elementary means. For specific 
values of a, b and c it can be evaluated using numerical methods. An alternative is to 
express the surface area in terms of elliptic integrals?) 


C 


11. Use Definition 4.3 to prove that the surface area S over a region R in R? of a surface 
z= f(x,y) is given by the formula 


S = [| i (GE) (85) 2a. 


(Hint: Think of the parametrization of the surface.) 


5BowMAN, F., Introduction to Elliptic Functions, with Applications, New York: Dover, 1961, § III.7. 
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4.5 Stokes' Theorem 


So far the only types of line integrals which we have discussed are those along curves in R?. 
But the definitions and properties which were covered in Sections 4.1 and 4.2 can easily be 
extended to include functions of three variables, so that we can now discuss line integrals 
along curves in R?. 


Definition 4.5. For a real-valued function f(x,y,z) and a curve C in R?, parametrized by 
x = x(t), y = y(t), z = z(t), a < t < b, the line integral of f(x,y,z) along C with respect to 
arc length s is 


b 
f(x, y,ds = f a E (4.34) 


The line integral of f(x,y,z) along C with respect to x is 


b 
[rev aas = || f (x(t), y(t), z(t) x (t)dt . 


The line integral of f(x, y,z) along C with respect to y is 


b 
M Aenea = f EO y (dt . 


The line integral of f(x,y,z) along C with respect to z is 


b 
Í e = f E 2) 2 dt . 


Similar to the two-variable case, if f (x,y,z) = 0 then the line integral Ic f (x,y,2)ds can be 
thought of as the total area of the “picket fence" of height f(x,y,z) at each point along the 
curve C in R?. 

Vector fields in R? are defined in a similar fashion to those in R?, which allows us to define 
the line integral of a vector field along a curve in R?. 


Definition 4.6. For a vector field f(x, y,z) = P(x,y,2)1- Q(x, y, 2)) - R(x, y,z)k and a curve C 


in R with a smooth parametrization x = x(t), y = y(t), z = z(t), a < t < b, the line integral 
of f along C is 


[tar = [ Pe» 22s + [ Q6 d» + [ 5e».22: (4.38) 
C C C C 


b 
- f f(x(t), y(0,2(0)-r'()dt , (4.39) 


where r(¢) = x(t)i+ y(t)j + z(t)k is the position vector for points on C. 
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Similar to the two-variable case, if f(x, y, z) represents the force applied to an object at a 
point (x, y, z) then the line integral fc. f-dr represents the work done by that force in moving 
the object along the curve C in R?. 

Some of the most important results we will need for line integrals in R? are stated below 
without proof (the proofs are similar to their two-variable equivalents). 


Theorem 4.10. For a vector field f(x, y,z) = P(x, y,z)i+ Q(x, y, 2))  R(x, y,z) k and a curve 
C with a smooth parametrization x = x(t), y = y(t), z = z(t), a < t < b and position vector 


r(t) = x(t)it y(t)j + z(Dk, 
Í f-dr = Í f-Tds, (4.40) 
C C 


where T(t) = no is the unit tangent vector to C at (x(t), y(t), z(t)). 


Theorem 4.11. (Chain Rule) If w = f(x,y,z) is a continuously differentiable function of 
x, y, and z, and x= x(t), y = y(t) and z = z(t) are differentiable functions of t, then w is a 
differentiable function of £, and 


dw ôw dx ôw dy ôw dz 


cep . DRE Ger . UP GET . CUN HE d 441 
mu C se Ope ee x 


Also, if x = x(t;,t;), y = y(t,,t;) and z = z(t,,t;) are continuously differentiable function of 


(ti, £5), then 
ðw _ Ow Ox Ow Oy Ow Oz 


pA y ee ee a Lue 4.42 
Ot: Ox Ot, Oy Ot, Oz Ot, f i 
dw ôw Ox Ow oy Ow Oz 


aset eas + — + — . 4.43 
Ot, Ox ôt, Oy Ot; Oz Ot; 


Theorem 4.12. Let f(x,y,z) = P(x,y,z)i - Q(x, y,z)j+ R(x, y, z)k be a vector field in some 
solid S, with P, Q and R continuously differentiable functions on S. Let C be a smooth 
curve in S parametrized by x = x(t), y = y(t), z = z(t), a <t <b. Suppose that there is a 
real-valued function F(x, y,z) such that VF =f on S. Then 


[tar = F(B) - F(A), (4.44) 
C 


where A = (x(a), y(a), z(a)) and B = (x(b), y(b), z(b)) are the endpoints of C. 


6See TAYLOR and MANN, $6.5 for a proof. 
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Example 4.12. Let f (x,y,z) - z and let C be the curve in R parametrized by 


x=tsint, y=tcost, z-t, Osztsz8m. 


Evaluate fo f (x, y, z) ds. (Note: C is called a conical helix. See Figure 4.5.1). 
Solution: Since x'(t)= sint + tcost, y'(t) 2 cost — tsint, and z'(t) - 1, we have 


x'(t + y(t)? - z (t = (sin? t+ 2tsintcost + t?cos? t) + (cos? t - 2tsintcost +t? sin? t) 1 
= t(sin? t+ cos? t) - sin? t - cos?t 1 


= +2, 


so since f (x(t), y(t), z(t)) = z(t) = t along the curve C, then 


8m 
Í AE E f f GXD, yE), 2) Vx")? + yD? 2 dt 
C 0 


8z 
= f tV 1? 4-2dt 
0 


8z 1 
=5 (64n? 4 2)? -2v2) : 


= (12 ui 
- st +2) ' 


Figure 4.5.1 Conical helix C 


Example 4.13. Let f(x, y,z) = xi yj * 2z K be a vector field in R?. Using the same curve C 


from Example 4.12, evaluate fc f-dr. 
Solution: It is easy to see that F(x, y,z) = aa + x +2? is a potential for f(x, y,z) (i.e. VF = f). 
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So by Theorem 4.12 we know that 


Í f-dr = F(B) — F(A) , where A = (x(0), y(0),z(0)) and B = (x(87), y(87), z(87)), so 
C 


= F(8zsin8z,8z2cos8z,82) — F(0sin0,0cos0,0) 
F(0,82, 82) — F(0,0,0) 


2 
o+ SO cim? - 0000) = 96z?. 


II 


We will now discuss a generalization of Green’s Theorem in RÊ to orientable surfaces in 
R?, called Stokes’ Theorem. A surface X in R? is orientable if there is a continuous vector 
field N in R? such that N is nonzero and normal to X (i.e. perpendicular to the tangent plane) 
at each point of X. We say that such an N is a normal vector field. 


For example, the unit sphere x?4- y?-- z? = 1 is orientable, since the 
continuous vector field N(x, y, z) = xit yj+zk is nonzero and normal 
to the sphere at each point. In fact, —N(x,y,z) is another normal 
vector field (see Figure 4.5.2). We see in this case that N(x, y,z) is 
what we have called an outward normal vector, and —N(x, y, z) is an 
inward normal vector. These “outward” and “inward” normal vec- 
tor fields on the sphere correspond to an “outer” and “inner” side, 
respectively, of the sphere. That is, we say that the sphere is a two- 
sided surface. Roughly, “two-sided” means “orientable”. Other ex- 
amples of two-sided, and hence orientable, surfaces are cylinders, 
paraboloids, ellipsoids, and planes. 

You may be wondering what kind of surface would not have two sides. An example is the 
Möbius strip, which is constructed by taking a thin rectangle and connecting its ends at 
the opposite corners, resulting in a “twisted” strip (see Figure 4.5.3). 


Figure 4.5.2 


A B 
B A 
(a) Connect A to A and B to B along the ends (b) Not orientable 


Figure 4.5.8 Mobius strip 


If you imagine walking along a line down the center of the Möbius strip, as in Figure 
4.5.3(b), then you arrive back at the same place from which you started but upside down! 
That is, your orientation changed even though your motion was continuous along that center 
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line. Informally, thinking of your vertical direction as a normal vector field along the strip, 
there is a discontinuity at your starting point (and, in fact, at every point) since your vertical 
direction takes two different values there. The Móbius strip has only one side, and hence is 
nonorientable." 

For an orientable surface 2 which has a boundary curve C, pick a unit normal vector n 
such that if you walked along C with your head pointing in the direction of n, then the 
surface would be on your left. We say in this situation that n is a positive unit normal vector 
and that C is traversed n-positively. We can now state Stokes' Theorem: 


Theorem 4.14. (Stokes' Theorem) Let X be an orientable surface in R? whose boundary 
is a simple closed curve C, and let f(x, y,z) = P(x, y,z)i+ Q(x, y,z)j + R(x,y,z)k be a smooth 
vector field defined on some subset of R? that contains X. Then 


f tdr = |[(cut)-nao, 
py 


Oy Oz Oz Ox ôx dy 


n is a positive unit normal vector over X, and C is traversed n-positively. 


i+ j+ 


E =i E S) (= =k. 


Proof: As the general case is beyond the scope of this text, we will prove the theorem only 
for the special case where È is the graph of z = z(x, y) for some smooth real-valued function 
z(x, y), with (x, y) varying over a region D in R?. 


Projecting X onto the xy-plane, we see that the closed I 


curve C (the boundary curve of X) projects onto a closed 
curve Cp which is the boundary curve of D (see Fig- 
ure 4.5.4). Assuming that C has a smooth parametriza- 
tion, its projection Cp in the xy-plane also has a smooth 
parametrization, say 


XE:z-z(x,y) 


Cp: x=x(t), y=y(t),ast<b, 


and so C can be parametrized (in R3) as 
C: x=x(t), y=y(t), z=2(x(t), y(t), ast<b, Figure 4.5.4 


since the curve C is part of the surface z = z(x, y). Now, by the Chain Rule (Theorem 4.4 in 
Section 4.2), for z = z(x(t), y(t)) as a function of t, we know that 
Oz ô 


x'() - Éy), 
y 


1 
t) = 
ZUE à 


"For further discussion of orientability, see O'NEILL, 8IV.7. 
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and so 
$ tdr - | aia a aia 
= [ [Ps (t)+Qy Orr (Ex! +o *y'e)) at 
z\ , Z| y 
-f (2+2 2] 0» [e «n E)» v) dt 
a Ox Oy 
- i. P(x, y)dx+Qa,y)dy , 
where 


x ô 
P(x,y) = P(x,y,z(x,y) + R(x, y,z(x, na „and 


Q(x,y) = Q(x, y,z(x, y)) + R(x, y, z(x, Woe mar y) 


for (x, y) in D. Thus, by Green's Theorem applied to the region D, we have 


fea- [[(2-B)aa am 


— = AA z |e: y, ZG, y) + R(x, y,z(x, ye ay »). so by the Product Rule we get 
ô (dz 
- T So. T Bos ! 


Now, by formula (4.42) in Theorem 4.11, we have 


0Q Ox 3 0Q Oy " 0Q oz 
‘Ox Ox Oy Óx Oz Ox 
0Q 0Q Qu 0Q Oz 
Ox Oy Oz Ox 
0Q | 0Q Oz 

Ox Oz Óx- 


ô 
= (Q(x, y, 2(x, y))) = 
Ox 


Similarly, 


ô 
ax UG y, 2G y») x + Oz Ox n 
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Thus, 


0Q aQ  óoQoOz [s OR 2) oe 0?z 
— = — + — — + | + — —|— +R —— 
QU a oa Lok ealo. 0 
0Q | 0Q0z  OROz OR dz dz 0?z 
= — + —— + —— + ——— + Re. 
Ox Oz Ox Ox Oy Oz Ox Oy Ox dy 
In a similar fashion, we can calculate 


ôP OP OP dz | OR dz OR dz Oz | 0?z 


= — + —— + —— + f 
Oy Oy Oz Oy Oy Ox Oz Oy Ox Oy Ox 


So subtracting gives 
aq E ôP H E jx " E: E A (S - = 
i Ox oy 


— i i RES e — (4.48) 
Óx Oy Oz Oy Ox Oz Ox Ody 


since we = x 3; by the smoothness of z = z(x, y). Hence, by equation (4.47), 


- ff (_(2R 992: (aP omae (ae oP 
ftar = [t Eae zoe E ele (se 5;) 24 a 


after factoring out a —1 from the terms in the first two products in equation (4.48). 
Now, recall from Section 2.3 (see p.76) that the vector N = -2i i- 2 ES zj +k is normal to the 
tangent plane to the surface z = z(x,y) at each point of È. Thus. 


No Zi- $i+k 
N NUS 
G^ (8) 


is in fact a positive unit normal vector to È (see Figure 4.5.4). Hence, using the param. 


tion r(x, y) = xi+ yj * z(x, y) k, for (x, y) in D, of the surface x, we have £- =i+ Ed k and 


Oz 
oy 


Z -j+ Ek, and so | x || = 1+(%)*-+(% 


2m ig So we see that using formula (4.46) for 


curl f, we have 
Or or 
— x — 


J eno ndo = l (curl £f)-n By 
j (zs) sa ala pl) (rast ag) 4 
Oy Oz Oz Ox ox ody Ox Oy 
gi mole ea Le ad) 
oy Ox Oz Ox) dy Ox | Oy 


which, upon comparing to equation (4.49), proves the Theorem. QED 


dA 
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Note: The condition in Stokes’ Theorem that the surface X have a (continuously vary- 
ing) positive unit normal vector n and a boundary curve C traversed n-positively can be 
expressed more precisely as follows: if r(t) is the position vector for C and T(t) = r'(t)/||r'(t)|| 
is the unit tangent vector to C, then the vectors T, n, T x n form a right-handed system. 

Also, it should be noted that Stokes' Theorem holds even when the boundary curve C is 
piecewise smooth. 


Example 4.14. Verify Stokes’ Theorem for f(x, y,z) = zi* xj * yk when X is the paraboloid 
z =x? + y? such that z < 1 (see Figure 4.5.5). 


Solution: The positive unit normal vector to the surface 
z= z(x, y) x? + y? is 


- -$mi-3)9^K  -2xi-2yj+k 
a3 alo 1 + 4 + ye 
1+ (8) +($) 


and curl f= (1-—0)i+(1-0)j+(1-0)k=i+j+k, so 


(curl f)-n = (—2x-2y+1)/\/1+4x2+4y? . i 


Figure 4.5.5 z-x?«y? 


Since X can be parametrized as r(x, y) = xi+ yj +(x? + y?)k for 
(x, y) in the region D = {(x, y) : x? + y? < 1), then 
or or 


— —— 


[| curt #)-ndo = Í (curl f)-n k dy 


X D 
-2x-2y41 
- J| A Vivo ta 
Jy V 1-44x? + Ay? 


= Í ii (-2x —-2y * 1)dA , so switching to polar coordinates gives 
D 


dA 


2m pl 
= f f (—-2rcos0 — 2r sinf + l)rdrd0 
0 0 


2m pl 
= Í f (-2r? cos0 — 2r? sin0 +r)dr d0 
0 0 


2n 
3 3. 2 |" 
= —2" cos0 — Z sing + = 
0 3 3 2 


r= 


1 
Jas 
0 


II 


27 
i (-2cos0- 2sin0 +4) d0 


27 
aeai 2 1 = 
= sind + 2cos0 + 30). =T. 
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The boundary curve C is the unit circle x? + y? = 1 laying in the plane z = 1 (see Figure 
4.5.5), which can be parametrized as x = cost, y = sint, z = 1 for 0 < t < 2z. So 


27 
j f-dr = ((1)(— sin t) + (cos£)(cos£) + (sin t)(0)) dt 
C 0 


2n 1-4 cos2t 1+cos2t 
Í [- sint+ — dt [here we used cos? t = a 
0 


27 


E t d sin2t 
cost + — 
2 4 


0 


So we see that fof: dr = ff (curl f)-ndo, as predicted by Stokes’ Theorem. 
bs 


The line integral in the preceding example was far simpler to calculate than the surface 
integral, but this will not always be the case. 


Example 4.15. Let = be the elliptic paraboloid z = z + z for z < 1, and let C be its boundary 
curve. Calculate fof- dr for f(x,y,z) = (9xz + 2y)i + (2x + y2j + (-25? + 2z)k, where C is 
traversed counterclockwise. 

Solution: The surface is similar to the one in Example 4.14, except now the boundary curve C 


is the ellipse 2 + be = 1 laying in the plane z = 1. In this case, using Stokes’ Theorem is easier 
than computing the line integral directly. As in Example 4.14, at each point (x, y, z(x, y)) on 


2 
the surface z = z(x,y) = E t e the vector 


is a positive unit normal vector to X. And calculating the curl of f gives 
curl f = (-4y - 0) + (9x—0)j + (2-2)k = —4yi + 9xj + Ok, 


so 
-4» C )* 93: 59 + OVA = 
(curl £):n = (74378) + ORE 3) € OD = 2xy uid " 
eI EM 


and so by Stokes' Theorem 


fre = [| ex )-ndo = [| oc -0. 
d » X 
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In physical applications, for a simple closed curve C the line integral fọ f-dr is often called 
the circulation of f around C. For example, if E represents the electrostatic field due to a 
point charge, then it turns out? that curl E = 0, which means that the circulation f, E-dr-0 
by Stokes' Theorem. Vector fields which have zero curl are often called irrotational fields. 

In fact, the term curl was created by the 19** century Scottish physicist James Clerk 
Maxwell in his study of electromagnetism, where it is used extensively. In physics, the 
curl is interpreted as a measure of circulation density. 'This is best seen by using another 
definition of curl f which is equivalent? to the definition given by formula (4.46). Namely, for 
a point (x, y, z) in R, 


1 
n:(curl f(x, y,z) = lim sf f-dr, (4.50) 
s—0S Jc 


where S is the surface area of a surface X containing the point (x,y,z) and with a simple 
closed boundary curve C and positive unit normal vector n at (x,y,z). In the limit, think of 
the curve C shrinking to the point (x,y,z), which causes X, the surface it bounds, to have 
smaller and smaller surface area. That ratio of circulation to surface area in the limit is 
what makes the curl a rough measure of circulation density (i.e. circulation per unit area). 


An idea of how the curl of a vector field is iy 

related to rotation is shown in Figure 4.5.6. P S 
Suppose we have a vector field f(x, y, z) which 
is always parallel to the xy-plane at each f 
point (x, y, z) and that the vectors grow larger 
the further the point (x, y,z) is from the y- 
axis. For example, f(x, y, 2) - (1 -- x?)j. Think 
of the vector field as representing the flow 
of water, and imagine dropping two wheels 
with paddles into that water flow, as in Fig- 
ure 4.5.6. Since the flow is stronger (i.e. the 
magnitude of f is larger) as you move away 0 7 
from the y-axis, then such a wheel would ro- 


tate counterclockwise if it were dropped to Figure 4.5.6 Curl and rotation 

the right of the y-axis, and it would rotate 

clockwise if it were dropped to the left of the y-axis. In both cases the curl would be nonzero 
(curl f(x, y, z) = 2xk in our example) and would obey the right-hand rule, that is, curl f(x, y, z) 
points in the direction of your thumb as you cup your right hand in the direction of the rota- 
tion of the wheel. So the curl points outward (in the positive z-direction) if x > 0 and points 
inward (in the negative z-direction) if x « 0. Notice that if all the vectors had the same di- 
rection and the same magnitude, then the wheels would not rotate and hence there would 
be no curl (which is why such fields are called irrotational, meaning no rotation). 


8See Ch. 2 in REITZ, MILFORD and CHRISTY. 
9See SCHEY, p. 78-81, for the derivation. 
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Finally, by Stokes’ Theorem, we know that if C is a simple closed curve in some solid 
region S in R and if f(x, y, z) is a smooth vector field such that curl f= 0 in S, then 


ftar = [[ enit nao = [[ 0 mac = ff odo = 0, 
" X X X 


where X is any orientable surface inside S whose boundary is C (such a surface is some- 
times called a capping surface for C). So similar to the two-variable case, we have a three- 
dimensional version of a result from Section 4.3, for solid regions in R? which are simply 
connected (i.e. regions having no holes): 


The following statements are equivalent for a simply connected solid region S in R: 


(a) f(x,y,2) = P(x,y,z)i- Q(x, y,z)j+ R(x, y, z) k has a smooth potential F(x, y,z) in S 


(b) Í f- dr is independent of the path for any curve C in S 
C 


(c) j f- dr = 0 for every simple closed curve C in S 
C 


OR ôQ OP OR 0Q OP. : : 
———— E — = .e. l1f- 
mir ay? one DUET in S (i.e. cur 0 in S) 


Part (d) is also a way of saying that the differential form P dx +Q dy +R dz is exact. 


Example 4.16. Determine if the vector field f(x, y, 2) = xyzit+x«zj+xyk has a potential in R?. 


Solution: Since R? is simply connected, we just need to check whether curl f = 0 throughout 
R3, that is, 
OR  0Q OP OR d 0Q OP 


zn , FICA an EUR 
Oy Oz Oz Ox ox | Oy 


throughout R?, where P(x,y,z) 2 xyz, Q(x, y,2) 2 xz, and R(x,y,z) 7 xy. But we see that 


oP OR OP OR 
—=xy,—=y > —F— for some (x,y,z) in R. 
Oz Ox Oz Ox 


Thus, f(x,y,z) does not have a potential in R?. 


A 


For Exercises 1-3, calculate fc f (x,y,2)ds for the given function f(x,y,z) and curve C. 


1. f(x,y,z)22; C:x=cost, y sint,z-t, 0t 2m 
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2. fx, y,z)= Se ys Dye; C:x=#?, y=t,z=1,1st<2 
y 


3. f(x, y,z)= 22; C:x=tsint, y=tcost, z= By2 812 O0<t<l1 
For Exercises 4-9, calculate fof- dr for the given vector field f(x, y, z) and curve C. 
f(x,y,z)=i-j+k; C:x=3t, y=2t,z=t,0<t<1 


. f(x,y,z)=yi-xj+zk; C:x=cost, y=sint,z=t,0<t<27 


4, 

5 

6. f(x, y,z)=xit+yj+zk; C:x=cost, y=sint,z=2,0<t<2z 

7. f(x,y,z2) Z(y-22))i o xyje (2xz- y)k; C:x=t, y=2t,z=t?-1,0<t<1 

8. f(x, y,z) 2 yzit+xzjt+xyk; C: the polygonal path from (0,0,0) to (1,0,0) to (1,2,0) 
9 


. f(x, y,z) =xyit+(z-—x)j+2yzk; C: the polygonal path from (0,0,0) to (1,0,0) to (1,2,0) 
to (1,2, 2) 


For Exercises 10-13, state whether or not the vector field f(x, y, z) has a potential in R (you 
do not need to find the potential itself). 


10. f(x, y,z)= yi-xjt+zk 11. f(x, y,z)=ai+bj+ck (a, b, c constant) 
12. f(x,y,z) 2 (x - yi xj z?k 13. f(x, y,z) 2 xyà- (x — yz2)j - y?zk 
B 


For Exercises 14-15, verify Stokes’ Theorem for the given vector field f(x, y, z) and surface È. 
14. f(x,y,z)=2yi-xj+zk; Z:x?-y?42?- 1,220 
15. f(x,y,z)=xyitxzjtyzk; L:z=x2+y?,2<1 


16. Construct a Mobius strip from a piece of paper, then draw a line down its center (like 
the dotted line in Figure 4.5.3(b)). Cut the Möbius strip along that center line completely 
around the strip. How many surfaces does this result in? How would you describe them? 
Are they orientable? 


17. Use Gnuplot (see Appendix C) to plot the Móbius strip parametrized as: 
r(u,v) = cosu(1+vecos>)i+sinu(1+vcos$)j+usin¢k, O0O<us2z, -i <u< i 
C 


18. Let X be a closed surface and f(x,y,z) a smooth vector field. Show that 
Jf (curl f£) - ndo - 0. (Hint: Split X in half.) 
X 


19. Show that Green's Theorem is a special case of Stokes' Theorem. 
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4.6 Gradient, Divergence, Curl and Laplacian 


In this final section we will establish some relationships between the gradient, divergence 
and curl, and we will also introduce a new quantity called the Laplacian. We will then show 
how to write these quantities in cylindrical and spherical coordinates. 

For a real-valued function f(x,y,z) on R?, the gradient Vf'(x, y,z) is a vector-valued func- 
tion on R?, that is, its value at a point (x, y,z) is the vector 


of à ô ô Ó 
VfGx,y,z) = (E. 2) Eur + n + Ti 


1t J 
Ox Oy Oz 
in R?, where each of the partial derivatives is evaluated at the point (x,y,z). So in this way, 
you can think of the symbol V as being “applied” to a real-valued function f to produce a 
vector Vf. 


It turns out that the divergence and curl can also be expressed in terms of the symbol V. 
This is done by thinking of V as a vector in R?, namely 


ô 
V = —i + —j + —k. (4.51) 


Here, the symbols 2, $ and 2 are to be thought of as “partial derivative operators” that 
will get “applied” to a real-valued function, say f(x,y,z), to produce the partial derivatives 


af ; of and or . For instance, 2 “applied” to f(x,y,z) produces EI 


Is V NE a vector? Strictly speaking, no, since 2,2 Lm and 2 ; are not actual numbers. But 
it helps to think of V as a vector, py with the roses and curl, as we will soon see. 
The process of “applying” 2, ae zz to a real-valued function f(x, y,z) is normally thought of 
as multiplying the quantities: 


[z)e-z. (zjo-z. (z)o-z 


For this reason, V is often referred to as the “del operator", since it “operates” on functions. 

For example, it is often convenient to write the divergence div f as V -f, since for a vector 
field f(x, y, 2) = fi(x, y, z)i+ fol, y, 2)) + fs(x, y, z)k, the dot product of f with V (thought of as a 
vector) makes sense: 


ô ô ô " è 
V-f= (=i + —j + Si) feyzi + fix, y, + fix, y, z)k) 
Ox Oy Oz 


ô 0 ô 
PEA i Fake 4 PE 
_ of; Lf. , af; 

Ox Oy Oz 


= divf 
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We can also write curl f in terms of V, namely as V x f, since for a vector field f(x, y,z) = 
P(x, y,z)i+ Q(x, y, 2)]j + R(x, y, z)k, we have: 


i j k 

vxi ô ô Ó 
x = — — — 
Ox Oy Oz 


P(x,y,z) Q(x,y,z) R(x, y,z) 


H E xj (5. =i " (S - x 

| \ðy dz à Ox Oz Ox dy 
ô ô ôP ð 

ye r8 (R-t 
Oy Oz Oz Ox Ox dy 

= curlf 


For a real-valued function f(x,y,z), the gradient Vf (x,y,z) = Fit sf j^ ot y is a vector 
field, so we can take its divergence: 


div Vf = V: Vf 
ô Ó ô ô ô ô 
= (zi + —j + zx + Ors + S x) 
y Oz Ox Oy Oz 
0 (ô ô (0 
EE 
Ox \ Ox Oy VOy 0z \ dz 
_ Pf Ef ef 
| Ox  0y) og 
Note that this is a real-valued function, to which we will give a special name: 


Definition 4.7. For a real-valued function f(x,y,z), the Laplacian of f, denoted by ^f, is 
given by 


UR uU BAe 


(4.52) 


Af(x,y,2)- V-Vf = — + — + : 
A f Ox? dy? dz? 


Often the notation V?f is used for the Laplacian instead of ^f, using the convention V? = 
V. V. 


Example 4.17. Let r(x, y,z) = xi+yj+zk be the position vector field on R?. Then ||r(x, y,z)|? = 
r-r=x?+y?+2? is a real-valued function. Find 


(a) the gradient of Ii? 
(b) the divergence of r 
(c) the curl of r 


(d) the Laplacian of Iri? 
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Solution: (a) V|r|? 2 2xi+2yj+2zk=2r 
(b) V-r=2(x)+ 20)-2(2-71*141-8 
(c) 


ij k 
Vxsc|9 2 71.4508 10-0] 4 (050)E 29 
Ox Oy Oz 
x y z 


(d) All? = Zo (x? + y? +27) + Fol? y! +2?) + 2^3 ey! +z?) 224242 =6 
Note that we could have calculated A|r||? another way, using the V notation along with parts 
(a) and (b): 
Al|ri? = V-Viirll? = V-2r = 2V-r = 2(3) = 6 
Notice that in Example 4.17 if we take the curl of the gradient of || r|? we get 
V x (Vir]?) = Vx2r = 2Vxr = 20 = 0. 


The following theorem shows that this will be the case in general: 


Theorem 4.15. For any smooth real-valued function f(x,y,z), V x (Vf) 2 0. 


Proof: We see by the smoothness of f that 


i j k 
ô ð ð 
Vx(Vf)- |ðx dy dz 
of of of 
dx dy dz 
af of af Of Of of 


= ee a a ee 6 | Áo —t— = ; 
Fes Dji p Lx (ss x] 


since the mixed partial derivatives in each component are equal. QED 


Another way of stating Theorem 4.15 is that gradients are irrotational. Also, notice that 
in Example 4.17 if we take the divergence of the curl of r we trivially get 


V-(Vxr) = V-0=0. 


The following theorem shows that this will be the case in general: 


Theorem 4.17. For any smooth vector field f(x, y,z), V-(V x f) = 0. 


The proof is straightforward and left as an exercise for the reader. 
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Proof: Let x be a closed surface which bounds a solid S. The flux of V x f through È is 


ffo xf):do = Is *(Vxf)dV (by the Divergence Theorem) 
x S 


Í OdV (by Theorem 4.17) 
S 


0. QED 


There is another method for proving Theorem 4.15 which can be useful, and is often used 
in physics. Namely, if the surface integral ff f(x, y,z) da = 0 for all surfaces X in some solid 
X 


region (usually all of R), then we must have f(x, y,z) = 0 throughout that region. The proof 
is not trivial, and physicists do not usually bother to prove it. But the result is true, and can 
also be applied to double and triple integrals. 

For instance, to prove Theorem 4.15, assume that f(x,y,z) is a smooth real-valued func- 
tion on R?. Let C be a simple closed curve in R? and let X be any capping surface for C (i.e. 
È is orientable and its boundary is C). Since Vf is a vector field, then 


[J eee 


j Vf*dr by Stokes’ Theorem, so 
C 


0 by Corollary 4.13. 


Since the choice of = was arbitrary, then we must have (V x (Vf))-n = 0 throughout R?, where 
n is any unit vector. Using i, j and k in place of n, we see that we must have V x (Vf) 2 0 in 
R?, which completes the proof. 


Example 4.18. A system of electric charges has a charge density (x, y,z) and produces an 
electrostatic field E(x, y, z) at points (x,y,z) in space. Gauss’ Law states that 


[| &:4« - ar || pdV 
x S 


for any closed surface X which encloses the charges, with S being the solid region enclosed 
by X. Show that V- E = 4zp. This is one of Maxwell's Equations.1? 


107 Gaussian (or CGS) units. 
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Solution: By the Divergence Theorem, we have 


js dV = Í E- do 


= 


An Í il p dV by Gauss’ Law, so combining the integrals gives 
S 


0 ,so 


Í (V-E-4mp) dV 
S 


V.E-4zp = 0 since X and hence S was arbitrary, so 
V-E = 4mp. 


Often (especially in physics) it is convenient to use other coordinate systems when dealing 
with quantities such as the gradient, divergence, curl and Laplacian. We will present the 
formulas for these in cylindrical and spherical coordinates. 

Recall from Section 1.7 that a point (x, y, z) can be represented in cylindrical coordinates 
(r,0,2), where x 2 rcos0, y 2 rsin0, z = z. At each point (r,0,2), let e,, eg, e; be unit vectors 
in the direction of increasing r, 0, z, respectively (see Figure 4.6.1). Then e,, eg, e; form an 
orthonormal set of vectors. Note, by the right-hand rule, that e; x e, = eg. 


v y "(x,y,0) 


Figure 4.6.1 Figure 4.6.2 
Orthonormal vectors e+, eo, ez Orthonormal vectors ep, eo, ej 
in cylindrical coordinates in spherical coordinates 


Similarly, a point (x,y,z) can be represented in spherical coordinates (p,0,@), where x = 
psindcos0, y = psinosin0, z = pcos. At each point (p,0,¢), let ep, eg, eg be unit vectors 
in the direction of increasing p, 0, p, respectively (see Figure 4.6.2). Then the vectors ep, eg, 
e, are orthonormal. By the right-hand rule, we see that eg x e, = ey. 

We can now summarize the expressions for the gradient, divergence, curl and Laplacian 
in Cartesian, cylindrical and spherical coordinates in the following tables: 
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Cartesian (x,y,z): Scalar function F; Vector field f = fii + f.j+ f; k 


gradient: VF = — 


divergence: V-f = — 


curl: V x f 
dy 
0°F 


Laplacian: AF = —~ 
aplacian TEE 


(2428); (or. 


of 4 (95 


ô 
oh) k 
Ox Ox 


i 
Oz Oy 


OF 


Oz 
ôF 


sq 
0y? oz? 


Cylindrical (7,0,2): Scalar function F; Vector field f= f. e, + fg eg + fz ez 


1 ôF 


gradient: VF = — 


divergence: V-f = 
r 


curl: Vxf 


OF 
Laplacian: AF = —— LZ) 
ror\ or 


r 00 
r 00 


Nae Pa 


[-e- 
r 00 Oz 


ru ME 
r2 00? 


eg + = 


1 Ofo 
Oz 


lí(0 Of, 
F (fe) - 3 ez 


Oz ôr 
oF 
Oz? 


10?F 


Spherical (0,0, «): Scalar function F; Vector field f = fp ep + fo eg + fy eo 


ô 
gradient: VF = — 


divergence: V-f = E fo) 
» Opes 
1 


curl: Vxf — (= 
psing ioo 


um 
psing 00 
OF 1 oF 1 ð 
A 


AF = EPA 2 


Laplacian: p 
p? Op 


Ss 
—— e 
psinó 00 | 


(sino fg) — 


beg 
pap ® 
1 dfe 1 ð 
CE 00 i psing ao" ino) 
ð e) 
ay J^? 


10 
= 5 EN 
| 55] 
PRA 


p? sin? o 80? ' p?sin$ dp 


The derivation of the above formulas for cylindrical and spherical coordinates is straight- 
forward but extremely tedious. The basic idea is to take the Cartesian equivalent of the 
quantity in question and to substitute into that formula using the appropriate coordinate 
transformation. As an example, we will derive the formula for the gradient in spherical 


coordinates. 
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Goal: Show that the gradient of a real-valued function F(p,0,«) in spherical coordinates is: 


OF ,_1 OF, | 10F 
= ——— —e — ——e 
psinó 00 ^ pdb ^ 


Idea: In the Cartesian gradient formula VF(x, y,2) — Ei E ay F j+ 2E az ôE k, put the Cartesian ba- 
sis vectors i, j, k in terms of the spherical coordinate m vectors ej, eg, eg and functions of 
p, 0 and $. Then put the partial derivatives or ; £ ; E in terms of A i T ; a and functions 
of p, 0 and 4. 


Step 1: Get formulas for ep, eg, eg in terms of i, j, K. 

We can see from Figure 4.6.2 that the unit vector e, in the p direction at a general point 
(p,0,9) is ep = ip where r = xi+ yj * zk is the position vector of the point in Cartesian 
coordinates. Thus, 


lr Vx? + y? + 2? : 


so using x = psindcos0, y = psindsin6, z = pcos, and p = y x? + y? +22, we get: 


ep = sin$ cosÜi + sing sin0j + cosok 


Now, since the angle 0 is measured in the xy-plane, then the unit vector eg in the 0 
direction must be parallel to the xy-plane. That is, eg is of the form ai+ bj Ok. To figure 
out what a and b are, note that since eg | ej, then in particular eg L ep when e, is in the 
xy-plane. That occurs when the angle ¢ is 7/2. Putting $ = 7/2 into the formula for ep gives 
e, = cosÜi-sin0j-- 0k, and we see that a vector perpendicular to that is — sin@i+cos0j+0k. 
Since this vector is also a unit vector and points in the (positive) 0 direction, it must be eg: 


r xityj+zk 
ep = ——— 


eg = —sin6Oi + cos0j + Ok 


Lastly, since ey = eg x ep, we get: 


ey = cos cosÜi + cos sin0j — sink 


Step 2: Use the three formulas from Step 1 to solve for i, j, k in terms of ep, eo, ey. 

This comes down to solving a system of three equations in three unknowns. There are 
many ways of doing this, but we will do it by combining the formulas for ep and eg to 
eliminate k, which will give us an equation involving just i and j. This, with the formula for 
eg, will then leave us with a system of two equations in two unknowns (i and j), which we 
will use to solve first for j then for i. Lastly, we will solve for k. 

First, note that 

singe, + cose, = cosÜi + sin0j 
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so that 


sin (sine, + cose) + cos0eg = (sin?8 »- cos?0)j = j, 


j = sindsin@e, + cos0eg + coso sinb ep 


and so: 


Likewise, we see that 


cos0(sinóe, + cospeg) — sind eg 


and so: 


= (cos?0 4 sin?0)i = i, 


i = sing cosÜe, — sinÜeg + coso cos0 ep 
k = cose, — sindeg 


Lastly, we see that: 


Step 3: Get formulas for as oE oF 


Og 
By the Chain Rule, we have 


in terms of ÎE, 9F oF 


Ox? Oy? üz* 


OF _ OF dx | OF dy , OF dz 
dp dx dp dy dp dz dp’ 
OF _ OF dx | OF dy | OF 3e 
00 | 0x00  0y00  0z00* 
OF _ ôF dx | OK dy | OF oz 
0p dx dp dy dh dz dp’ 


which yields: 


: OF : . OF OF 
sind cos — + sing sind — + cos — 
Ox Oy Oz 


. . OF . or 
—psing sind — + psind cos — 
Ox ð 


OF . OF . ,0F 
p cos cos — + pcos sinf — — psinó — 
Ox Oy Oz 


Step 4: Use the three formulas from Step 3 to solve for — 


OF OF OF. 
Ox? Oy” Oz 


in terms of 22 


OF OF 
Op’ 00° 0j 


Again, this involves solving a system of three equations in three unknowns. Using a 
similar process of elimination as in Step 2, we get: 


psing 


sil 
~( OF 
—|pcosd— — sind— 
p 0p 


OF 
[o sin? œ cos0 ae 


OF 


Op 


00 


00 


OF 
— sind — + sino cos cos0 — 


ô 


oF 

| 

2r) 
$ 


OF OF 
p sin? puppe + cos — + sing cos sind — 
0p 


4.6 Gradient, Divergence, Curl and Laplacian 185 


Step 5: Substitute the formulas for i, j, k from Step 2 E the MURUS for E, Z ; a from 


Step 4 into the Cartesian gradient formula VF(x, y, z) = Sz Fi + eit ok. 


Doing this last step is perhaps the most tedious, since it De simplifying 3x34+3x3+ 
2 x 2 = 22 terms! Namely, 


VF = [osing cos0 2m — sinO ai + sing cos¢ cos 55] (sin $ cos0 e, — sin0 eg 
psing Op 00 Ob 
+ cos $ cos0 eg) 
+ [o sin? $ sind 2 t cos0 E t sin $ cos $ sin 55] (sing sinf e, + cos0 eg 
psing Op 00 Ob 
+cos¢ sinf e) 


1 F OF 
+ 5 = (pcos sing a; (easier —singeg) , 


which we see has 8 terms involving ep, 6 terms involving eg, and 8 terms involving eg. But 
the algebra is straightforward and yields the desired result: 
OF 1 OF 1 OF 


VF = —e, + — eg + 
ap ^ * psin 00 ^ pap 


Example 4.19. In Example 4.17 we showed that VI ri? = 2r and Al ri? = 6, where r(x, y,z) = 
xi+ yj+zk in Cartesian coordinates. Verify that we get the same answers if we switch to 
spherical coordinates. 

Solution: Since |r||? = x? + y? +22 = p? in spherical coordinates, let F(p,0,9) = p? (so that 
F(p,0,0) — Ir||2). The gradient of F in spherical coordinates is 


pe Of oma. OR. 
— Op ? zx EL 


(O)eg + = (eg 


= 2pep + 


miss 


= 2pe, = 2p —- , as we showed earlier, so 


= 
r 
= 2p " — 2r, as expected. And the Laplacian is 


xp RAE 1 OF 1 ? (si | 
= ——— — ———— — t ———— —|snó-—— 
p? dp P dp p2sin? 00? ^ pp? sing 0$ ur 
1ôð ə 1 1 à 
= ——(p?2p) + ———0 0 
p? ap? 2 Pang * = p? sino dp ape) 
1 à 
= ——(2)+0 +0 
p? dp 


1 
= — (6p?) = 6, as expected. 
p 
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A 

For Exercises 1-6, find the Laplacian of the function f(x, y,z) in Cartesian coordinates. 
1. f(x,y,z) =x+y+z 2. f(x, y,z) S x? 3. f(x, y,z) = (x? + y? + 2292 
4. f(x,y,z) S er tt 5. f (x,y,z) 2 x39 + y9 +23 6. f(x,y,z)- e -Y-z 


7. Find the Laplacian of the function in Exercise 3 in spherical coordinates. 


8. Find the Laplacian of the function in Exercise 6 in spherical coordinates. 


9. Let f(x, y,z)= in Cartesian coordinates. Find Vf in cylindrical coordinates. 


z 
x2 + y? 
10. For f(r,9,2) re, z sin0eg + rze, in cylindrical coordinates, find div f and curl f. 


11. For f(p,0,9) = ep + p cos0 eg + peg in spherical coordinates, find div f and curl f. 
B 


For Exercises 12-23, prove the given formula (r = ||r|| is the length of the position vector field 
r(x,y,z) 2 xi^ yj*zk). 


12. V(I/r)  -r/r 13. A(1/r) =0 14. V-(r/r?) = 0 15. Vdnr)=r/r? 
16. div(F +G) = div F + div G 17. curl(F +G) = curl F + curl G 

18. div(f F) = f div F + F- Vf 19. div(F x G) = G- curl F — F-curlG 
20. div(Vf x Vg) = 0 21. curl(f F) = fcurl F + (Vf)xF 
22. curl(curl F) = V(div F) - AF 23. A(fg) = f Ag + gAf  XVf- Vg) 
C 


24. Prove Theorem 4.17. 


25. Derive the gradient formula in cylindrical coordinates: VF — op e-+ 1 2 eg + or e; 


26. Use f= u Vv in the Divergence Theorem to prove: 
(a) Green's first identity: fff (u Av + (Vu)+(Vv))dV = ff (u Vv): de 
S > 


(b) Green's second identity: fff (u Nv — vAu)dV = ff(uVv — vVu):da 
S 2 
27. Suppose that Au = 0 (i.e. u is harmonic) over R?. Define the normal derivative ou ofu 


over a closed surface 2 with outward unit normal vector n by gu = D,u=n-Vu. Show 
that ff gu do =0. (Hint: Use Green's second identity.) 
2 
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Appendix A 


Answers and Hints to Selected Exercises 


Chapter 1 


Section 1.1 (p. 8) 


1.(a) v5 (b)v5 
(e 2/17 2. Yes 


(0 V17 (d1 
3. No 


Section 1.2 (p. 14) 


1.(a)(-4,4,-3) (b)(2,6,-1) 

© (z, 2h) (d) XH (e) XH 
(£(14,-6,8) (g) (-7,8,—4) 
(h) (-1,-6,1) (i) (-2,-4,2) 
3. No. || v|| + || wl| is larger. 


(j) No. 


Section 1.3 (p. 18) 


1.10 3.73.4° 5.90° "7.0? 
9. Yes, since v: w = 0. 
11. |v-w| 20 « V21V5 - [vl || wll 


13. | v - wll = v26 < 21+ V5 = lvl + Iw 
15. Hint: use Definition 1.6. 
24. Hint: See Theorem 1.10(c). 


Section 1.4 (p. 29) 


1. (-5,-23,-24) 3.(8,4,-5) 5.0 
7.16.72 9.4/5 11.9 13.0 
and (8,-10,2) 15.14 


Section 1.5 (p. 39) 


1. (a) (2,3,-2)+46,4,-3) (b) x=2+5t, 
y-8*4tz-2-2-8t (0 2st Pa 


~ 4 —. -8 
3. (a) (2,1,3)+ £(1,0, 1) 


(b) x 22-4 t, 


y=1,z=3+t (c)x-2=2-3,y=1 
5. x=1+2t, y 2 -2- Tt, z 2 —83-8t 
7.7.65 9. (1,2,3) 

11.4x—4y *32—10-0 

13. x -2y-z-220 


15. 1lx—24y+21z-26=0  17.9//35 

19. x =5t, y=2+3t,z=-T7t 21. (10,-2,1) 
Section 1.6 (p. 46) 

1. radius: 1, center: (2,3,5) 3. radius: 5, 


center: (C1,—1,—1) 5. No intersection. 
7. circle x? + y? = 4 in the planes z = 4 V5 
9. lines £-2,2-0and£--7,2-0 


13. (24, 25.0) 


Section 1.7 (p. 50) 


1.((42,-2 (b (17,2,1. D. 

3. (a) (2V7, 47,0) (b) (2v7, 17,5 

5. (a) r?+z?=25 (b)p=5 

7. (a) r?+9z?=36 (b) p?(1-- 8cos? p) = 36 
10. (a,0,acot@) 12. Hint: Use the distance 
formula for Cartesian coordinates. 


Section 1.8 (p. 57) 


1. f'(é) = (1,245,312; x - 14 t, y- 2-1 

3. f(t) = (-2sin21,2c0s21,1); x= 1, 
y=2t,z=t 5.v(t)  (1,1— cost,sint), 

a(t) = (0, sinf,cost) 

9. (a) Line parallel to c (b) Half-line paral- 
leltoc (c) Hint: Think of the 
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functions as position vectors. 
15. Hint: Theorem 1.16 


Section 1.9 (p. 63) 


1.27Y5 3, 2(532-8) 5. Replace 


2/3 
t by (s) -4 6. Hint: Use 
Theorem 1.20(e), Example 1.37, and 
Theorem 1.16 7. Hint: Use Exercise 6. 
9. Hint: Use f'(t) = |f(2|T, differentiate 
that to get f(t), put those expressions into 
f'(t) x f(t), then write T'(t) in terms of 


NG). 11. T()- Jg (7 sint, cost, 1), N(t) = 
(-—cost,—sint,0), B(t) = Jg int, - cost, 1), 
x(t) = 1/2 

Chapter 2 


Section 2.1 (p. 70) 


1. domain: R?, range: [-1,00) 3. domain: 
(Gc, y) : x? + y? = 4}, range: [0,00) 

5. domain: R?, range: [-1,1] 7.1 

9. does not exist 11.2 13.2 15.0 

17. does not exist 


Section 2.2 (p. 74) 


1. SL 22x, Laay 8. = x? e y 4) 17, 


= io? 1j. V2 5. f — ye +y, T - 
xe" +x "7 aL = 4x3, L =0 

9. OF = (x? + yy?) 12 a. ya? +y 2)- 1/2 

11. 9f = 2:(42 + y c 4)- 218, 

or [ioa *y-4) 93. 13, Laxey"), 


- —2ye -+y 15. or E ent 


AA 17. cs at =2, 
FE =0 19.75 (yt aye? +y +4) 32, 
BF 


37 io? +y+4)-32, 


Appendix A: Answers and Hints to Selected Exercises 


kho dips 

21. Čí - gre" a 2 m = xe, 
ZL-Qexye" 41 23. ef = 1233, 
2 

TE =0, ZE =0 25. Z$ =-x?, 
o -2 f 

ôy? D Ox Oy =0 


Section 2.3 (p. 77) 

1. 2x+3y-z-38=0 3.-2x+y-z-2=0 
5. x-2y-z 7. lx- 0 « $(-2)* XH 
24)-0 9, 3x+4y—5z=0 


(z — 


Section 2.4 (p. 82) 


x 
1. (2x,2y) 3. Xu Wy 
5. (1/x, 1/y) 
7. (yzcos(xyz), xz cos(xyz), xy cos(xyz)) 
9. (2x,2y,2z) 11.2V2 18. Wi 
15. V3cos(1) 17. increase: (45,20), 
decrease: (—45, —20) 


Section 2.5 (p. 88) 


1. local min. (1,0); saddle pt. (-1,0) 

3. local min. (1,1); local max. (-1,—1); sad- 
dle pts. (1,-1),(-1,1) 5. local min. (1,—1); 
saddle pt. (0,0) 7. local min. (0,0) 

9. local min. (-1,1/2) 11. width = height = 
depth=10 13. x=y=4,z=2 


Section 2.6 (p. 95) 


2. (xy) = (0,0) : — (0.2858,—0.3998); 
(xo, yo) = (1, 1) : — (1.03256, — 1.94037) 


Section 2.7 (p. 100) 


: -4 -2]|. 4 2 
1. min. = 2); max. (4.4) 
: 20 30 20 30 
. min. | ==, — 5; max. | -———— 
? | 13” Ji = ( 13’ 2] 


cer ANE" v5) 1^4 
5. 3/3 
Chapter 3 
Section 3.1 (p. 104) 
1.1 3.55 54 7.5 9.1 11.15 
Section 3.2 (p. 109) 
1.1 3. 8In2-3 5.7 6.1 7.2 9.4 


6 
10. $ 


Section 3.3 (p. 112) 


9 
1.2 


3. (2cos(12) - 3$ —2)/4. 5. i 
10. i 


Section 3.4 (p. 116) 


1. The values should converge to = 1.318. 
(Hint: In Java the exponential function e* 
can be obtained with Math.exp(x). Other 
languages have similar functions, otherwise 
use e = 2.7182818284590455 in your pro- 
gram.) 


2. =1.146 3.420.705 4. «0.168 
Section 3.5 (p. 123) 
1.82 3. (8-397) 7.1—82? 9, 2nab 


Section 3.6 (p. 127) 
1. (1,8/3) 3. (0,44) 5. (0,32/16) 
7. (0,0,5a/12) 9. (7/12, 7/12, 7/12) 
Section 3.7 (p. 134) 


1. /z 2.1 6. Both are 7.4 


——— nl 
(n+1)*(n+2) 
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Chapter 4 


Section 4.1 (p. 142) 


1.1/2 3.23 5.24m %7.-2n 9.27 
11.0 


Section 4.2 (p. 149) 


1.0 3.No 4. Yes. F(x,y)= x — z 
5. No 9. (b) No. Hint: Think of how F is 
defined. 10. Yes. F(x,y)=axy+bx+cy+d 


Section 4.3 (p. 155) 


1. 16/15 3. -5m 5. Yes. F(x,y) = xy? + x? 
7. Yes. F(x,y) = Ax? y + 2? +3x 


Section 4.4 (p. 163) 
1.2167 2.3 3.127/5 7. 15/4 


Section 4.5 (p. 175) 


1. 2V27? 2.(17V17-5v5V3 3.2/5 

4.2 5.2n(1-1) 7.67/15 9.6 

11. Yes 13. No 19. Hint: Think of how 
a vector field f(x, y) = P(x, y)it Q(x, y)j in R? 
can be extended in a natural way to be a vec- 
tor field in R. 


Section 4.6 (p. 186) 
1.0 3.12yx?- y?«2? 5.6l(x+y+z) 


7.12p 8.(4p?-6)e? 9.-%2e,+4e, 
11. div f= 2 - s + cota; 

curl f = cot¢ cose, + 2eg — 2cos0 eg 

25. Hint: Start by showing that e, = cosdi+ 


sin0j, eg = -sinfi + cos0j, e, =k. 


Appendix B 


We will prove the right-hand rule for the cross product of two vectors in R?. 


For any vectors v and w in R?, define a new vector, n(v, w), as follows: 
, = , 


1. If v and w are nonzero and not parallel, and 0 is the angle between them, then n(v, w) is 
the vector in R? such that: 


(a) the magnitude of n(v,w) is || v|| | w|| sind, 
(b) n(v,w) is perpendicular to the plane containing v and w, and 


(c) v, w, n(v, w) form a right-handed system. 
2. If v and w are nonzero and parallel, then n(v, w) = 0. 
3. If either v or w is 0, then n(v, w) = 0. 


The goal is to show that n(v, w) = v x w for all v, w in R?, which would prove the right-hand 
rule for the cross product (by part 1(c) of our definition). To do this, we will perform the 
following steps: 


Step 1: Show that n(v,w) = v x w if v and w are any two of the basis vectors i, j, k. 


This was already shown in Example 1.11 in Section 1.4. v 


Step 2: Show that n(av, bw) = ab(v x w) for any scalars a, b if v and w are any two of the 
basis vectors i, j, k. 
If either a = 0 or b = 0 then n(av, bw) = 0 = ab(v x w), so the result holds. So assume that 
a #0 and b Z0. Let v and w be any two of the basis vectors i, j, k. For example, we will show 
that the result holds for v = i and w = k (the other possibilities follow in a similar fashion). 
For av = ai and bw = bk, the angle 0 between av and bw is 90°. Hence the magnitude 
of n(av, bw), by definition, is ||ail| || bk|| sin90° = |ab|. Also, by definition, n(av, bw) is per- 
pendicular to the plane containing ai and bk, namely, the xz-plane. Thus, n(av,bw) must 
be a scalar multiple of j. Since its magnitude is |ab|, then n(av, bw) must be either |ab|j or 
—|ablj. 
There are four possibilities for the combinations of signs for a and b. We will consider the 
case when a » 0 and b » 0 (the other three possibilities are handled similarly). 
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In this case, n(av, bw) must be either abj or —abj. Now, since i, j, k form a right-handed 
system, then i, k, j form a left-handed system, and so i, k, —j form a right-handed system. 
Thus, ai, bk, —abj form a right-handed system (since a > 0, b > 0, and ab > 0). So since, by 
definition, ai, bk, n(ai, bk) form a right-handed system, and since n(ai, bk) has to be either 
abj or —abj, this means that we must have n(ai, bk) = —abj. 

But we know that aix bk = ab(ix k) = ab(-j) = -abj. Therefore, n(ai, bk) = ab(i x k), 
which is what we needed to show. 

'. n(av,bw)- ab(vx w) v 


Step 3: Show that n(u, v + w) = n(u, v) + n(u, w) for any vectors u, v, w. 


If u = 0 then the result holds trivially since n(u, v + w), n(u,v) and n(u, w) are all the zero 
vector. If v = 0, then the result follows easily since n(u,v + w) = n(u,0+ w) = n(u,w) = 
0+ n(u, w) = n(u,0)+ n(u, w) = n(u,v)+ n(u, w). A similar argument shows that the result 
holds if w = 0. 

So now assume that u, v and w are all nonzero vectors. We will describe a geometric 
construction of n(u,v), which is shown in the figure below. Let P be a plane perpendicular 
to u. Multiply the vector v by the positive scalar ||u||, then project the vector || ull v straight 
down onto the plane P. You can think of this projection vector (denoted by projp||u|| v) as 
the shadow of the vector ||u|| v on the plane P, with the light source directly overhead the 
terminal point of || u|| v. If 0 is the angle between u and v, then we see that projp||ul|| v has 
magnitude || u| ||v|| sin0, which is the magnitude of n(u,v). So rotating projp||ul||v by 90° 
in a counter-clockwise direction in the plane P gives a vector whose magnitude is the same 
as that of n(u, v) and which is perpendicular to projp||ul|| v (and hence perpendicular to v). 
Since this vector is in P then it is also perpendicular to u. And we can see that u, v and 
this vector form a right-handed system. Hence this vector must be n(u,v). Note that this 
holds even if u || v, since in that case 0 = 0? and so sin0 = 0 which means that n(u, v) has 
magnitude 0, which is what we would expect. 


^N 


<- 


projplulv ^ 


n(u, v) 


Now apply this same geometric construction to get n(u, w) and n(u, v + w). Since ||ul| (v + 
w) is the sum of the vectors ||u|| v and ||u|| w, then the projection vector projp||ul| (v +w) is 
the sum of the projection vectors projp||u||v and projp||ul| w (to see this, using the shadow 
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analogy again and the parallelogram rule for vector addition, think of how projecting a 
parallelogram onto a plane gives you a parallelogram in that plane). So then rotating all 
three projection vectors by 90? in a counter-clockwise direction in the plane P preserves that 
sum (see the figure below), which means that n(u, v + w) = n(u,v) - n(u,w). v 


[ul v 


lull(v+w) .--- 


SCC a 


- 


projplul (v4 w) «dc 


projp|ulw 


n(u, v) 


n(u, v +w) 


Step 4: Show that n(w, v) = -n(v, w) for any vectors v, w. 


If v and w are nonzero and parallel, or if either is 0, then n(w, v) = 0 = —n(v, w), so the result 
holds. So assume that v and w are nonzero and not parallel. Then n(w,v) has magnitude 
| w|| || v|| sin@, which is the same as the magnitude of n(v, w), and hence is the same as the 
magnitude of -n(v, w). By definition, n(v, w) is perpendicular to the plane containing w and 
v, and hence so is —n(v,w). Also, v, w, n(v,w) form a right-handed system, and so w, v, 
n(v, w) form a left-handed system, and hence w, v, —n(v,w) form a right-handed system. 
Thus, we have shown that —n(v,w) is a vector with the same magnitude as n(w, v) and is 
perpendicular to the plane containing w and v, and that w, v, —n(v,w) form a right-handed 
system. So by definition this means that —n(v, w) must be n(w,v). v 


Step 5: Show that n(v, w) = v x w for all vectors v, w. 


Write v 2 vit v;j- v, k and w 2 w,i+w,j+w,k. Then by Steps 3 and 4, we have 
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n(v,w) = n(v,i+v,j+v;k,w,i+w,j+w,k) 
= n(v,i+v,j+v,k,w,i) + n(v,i+v,j+v,k,w.j+w;k) 
= n(v,i+v,jt+u,k,w,i) + n(v,i+v,j+v,k,w.j) + n(v,i+v,j+v;,k,w,k) 


= —n(w,i,v,i+v,j+v,k) + —n(w.j,v,i+v,jt+u,k) + —n(w,k,v,i+v,j+v;k). 


We can use Steps 1 and 2 to evaluate the three terms on the right side of the last equation 
above: 


—n(w,i,v,i+ v,j+v;k) = —n(wy,i,v,i) + -n(w,iv;j + —n(w,i,v,k) 
= —vw;n(üj) + —v,w,nG,j) + —v,w ni, k) 
= -—v,W,(ix i) + —v.W,(ixj) + —v,W,G x k) 
= —vw;0 + —v,w,k + —v,w,(-j) 


—n(Ww,i,v,i+v,j+u;k) = -v;w,k + vywj 
Similarly, we can calculate 
—n(w,j,v,i+v,jt+tu;k) = viw;k — v4w;i 
and 
—n(w,k,v,i+v,j+v;k) = —viwsj + Vwi. 
Thus, putting it all together, we have 


n(v,w) = —v,W,k + v3,W,j + viw;k — Vwi — v4wsj) + v;w;i 


= (Us; — UsW5)i + (V3W1—U,W3)j + (vw; — vw) k 


vxw by definition of the cross product. 


'. n(v,w) = v x w for all vectors v, w. v 


So since v, w, n(v,w) form a right-handed system, then v, w, v x w form a right-handed 
system, which completes the proof. 


Appendix C 


3D Graphing with Gnuplot 


Gnuplot is a free, open-source software package for producing a variety of graphs. Versions 


are available for many operating systems. Below is a very brief tutorial on how to use 
Gnuplot to graph functions of several variables. 


INSTALLATION 


1. 


Go to http://www. gnuplot.info/download.html and follow the links to download the lat- 
est version for your operating system. For Windows, you should get the Zip file with a 
name such as gp420win32.zip, which is version 4.2.0. All the examples we will discuss 
require at least version 4.2.0. 


. Install the downloaded file. For example, in Windows you would unzip the Zip file you 


downloaded in Step 1 into some folder (use the “Use folder names” option if extracting 
with WinZip). 


RUNNING GNUPLOT 


1. 


In Windows, run wgnuplot.exe from the folder (or bin folder) where you installed Gnu- 
plot. In Linux, just type gnuplot in a terminal window. 


. You should now get a Gnuplot terminal with a gnuplot> command prompt. In Windows 


this will appear in a new window, while in Linux it will appear in the terminal window 
where the gnuplot command was run. For Windows, if the font is unreadable you can 
change it by right-clicking on the text part of the Gnuplot window and selecting the 
“Choose Font..” option. For example, the font “Courier”, style “Regular”, size “12” is 
usually a good choice (that choice can be saved for future sessions by right-clicking in the 
Gnuplot window again and selecting the option to update wgnuplot.ini). 


. At the gnuplot> command prompt you can now run graphing commands, which we will 


now describe. 


GRAPHING FUNCTIONS 


The usual way to create 3D graphs in Gnuplot is with the splot command: 


splot <range> <comma-separated list of functions> 
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For a function z = f(x, y), «range» is the range of x and y values (and optionally the range 
of z values) over which to plot. To specify an x range and a y range, use an expression of the 
form [a : b][c : d], for some numbers a < b and c < d. This will cause the graph to be plotted 
fora<x<bandc<y<d. 


Function definitions use the x and y variables in combination with mathematical operators, 
listed below: 


[Symbol | Operation [Example | Result | 
[ - [Subtraction | 3-2 | 1 - 
[ * | Multiplication | 78 | $6 | 


Pepe | e e» s 


Example C.1. To graph the function z = 2x? y? from x = —1 to x = 1 and from y = -2 to 
y = 2, type this at the gnuplot> prompt: 


splot [-1:1][-2:2] 2*x**2 + yx«2 


The result is shown below: 


Qexx elt y* #2 


QO Hn Cus CO UO -I1 
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Note that we had to type 2*x**2 to multiply 2 times x?. For clarity, parentheses can be used 
to make sure the operations are being performed in the correct order: 


splot [-1:1][-2:2] 2*(x**2) + yx«2 


In the above example, to also plot the function z = e**" on the same graph, put a comma 
after the first function then append the new function: 


splot [-1:1][-2:2] 2*(x**2) + y**2, exp(x-*y) 


By default, the x-axis and y-axis are not shown in the graph. To display the axes, use this 
command before the splot command: 


set zeroaxis 


Also, by default the x- and y-axes are switched from their usual position. To show the axes 
with the orientation which we have used throughout the text, use this command: 


set view 60,120,1,1 
Also, to label the axes, use these commands: 


set xlabel "x" 


set ylabel "y 


set zlabel "z" 


To show the level curves of the surface z = f(x,y) on both the surface and projected onto the 
x y-plane, use this command: 
set contour both 


The default mesh size for the grid on the surface is 10 units. To get more of a colored/shaded 
surface, increase the mesh size (to, say, 25) like this: 


set isosamples 25 


Putting all this together, we get the following graph with these commands: 


set zeroaxis 

set view 60,120,1,1 
set xlabel "x" 

set ylabel "y" 
set zlabel "z" 
set contour both 
set isosamples 25 


splot [-1:1][-2:2] 2*(x**2) + y««2, exp(xty) 
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A*x**2c-yx**2 


The numbers listed below the functions in the key in the upper right corner of the graph 
are the "levels" of the level curves of the corresponding surface. That is, they are the num- 
bers c such that f(x,y) 2 c. Because of the large number of level curves, the key was put 
outside the graph with the set key outside command. If you do not want the function key 
displayed, it can be turned off with this command: unset key 


PARAMETRIC FUNCTIONS 


Gnuplot has the ability to graph surfaces given in various parametric forms. For example, 
for a surface parametrized in cylindrical coordinates 


x-rcosÜ, y-rsinÜü, z=z 


you would do the following: 


set mapping cylindrical 
set parametric 
splot [a:b][c:d] v«cos(u),vxsin(u),f(u,v) 


where the variable u represents 0, with a < u x b, the variable v represents r, with c <v < d, 
and z= f (u,v) is some function of u and v. 


Example C.2. The graph of the helicoid z = 0 in Example 1.34 from Section 1.7 (p. 49) was 
created using the following commands: 
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set mapping cylindrical 
set parametric 

set view 60,120,1,1 

set xyplane 0 

set xlabel "x" 

set ylabel "y" 
set zlabel "z" 
unset key 

set isosamples 15 


splot [0:4*pi][@:2] v«xcos(u),vxsin(u),u 


The command set xyplane 0 moves the z-axis so that z = 0 aligns with the xy-plane (which 
is not the default in Gnuplot). Looking at the graph, you will see that r varies from 0 to 2, 
and 0 varies from 0 to 47. 


PRINTING AND SAVING 


In Windows, to print a graph from Gnuplot right-click on the titlebar of the graph’s window, 
select “Options” and then the “Print..” option. If that does not work on your version of 
Gnuplot, then go to the File menu on the main Gnuplot menubar, select “Output Device ...”, 
and enter pdf in the Terminal type? textfield, hit OK. That will allow you to print the graph 
as a PDF file. 

To save a graph, say, as a PNG file, go to the File menu on the main Gnuplot menubar, 
select “Output Device ...”, and enter png in the Terminal type? textfield, hit OK. Then, in the 
File menu again, select the “Output ...” option and enter a filename (say, graph.png) in the 
Output filename? textfield, hit OK. Now run your splot command again and you should see 
a file called graph.png in the current directory (usually the directory where wgnuplot. exe is 
located, though you can change that setting using the “Change Directory ...” option in the 
File menu). 


In Linux, to save the graph as a file called graph.png, you would issue the following com- 
mands: 


set terminal png 

set output 'graph.png' 
and then run your splot command. There are many terminal types (which determine the 
output format). Run the command set terminal to see all the possible types. In Linux, 
the postscript terminal type is popular, since the print quality is high and there are many 
PostScript viewers available. 


To quit Gnuplot, type quit at the gnuplot» command prompt. 


GNU Free Documentation License 


Version 1.2, November 2002 
Copyright €2000,2001,2002 Free Software Foundation, Inc. 


51 Franklin St, Fifth Floor, Boston, MA 02110-1301 USA 


Everyone is permitted to copy and distribute verbatim copies of this license document, but 
changing it is not allowed. 


Preamble 


The purpose of this License is to make a manual, textbook, or other functional and useful 
document "free" in the sense of freedom: to assure everyone the effective freedom to copy 
and redistribute it, with or without modifying it, either commercially or noncommercially. 
Secondarily, this License preserves for the author and publisher a way to get credit for their 
work, while not being considered responsible for modifications made by others. 

This License is a kind of "copyleft", which means that derivative works of the document 
must themselves be free in the same sense. It complements the GNU General Public License, 
which is a copyleft license designed for free software. 

We have designed this License in order to use it for manuals for free software, because free 
software needs free documentation: a free program should come with manuals providing the 
same freedoms that the software does. But this License is not limited to software manuals; it 
can be used for any textual work, regardless of subject matter or whether it is published as a 
printed book. We recommend this License principally for works whose purpose is instruction 
or reference. 


1. APPLICABILITY AND DEFINITIONS 


This License applies to any manual or other work, in any medium, that contains a notice 
placed by the copyright holder saying it can be distributed under the terms of this License. 
Such a notice grants a world-wide, royalty-free license, unlimited in duration, to use that 
work under the conditions stated herein. The "Document", below, refers to any such manual 
or work. Any member of the public is a licensee, and is addressed as "you". You accept 
the license if you copy, modify or distribute the work in a way requiring permission under 
copyright law. 

A "Modified Version" of the Document means any work containing the Document or a 
portion of it, either copied verbatim, or with modifications and/or translated into another 
language. 
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A "Secondary Section" is a named appendix or a front-matter section of the Document 
that deals exclusively with the relationship of the publishers or authors of the Document 
to the Document’s overall subject (or to related matters) and contains nothing that could 
fall directly within that overall subject. (Thus, if the Document is in part a textbook of 
mathematics, a Secondary Section may not explain any mathematics.) The relationship 
could be a matter of historical connection with the subject or with related matters, or of 
legal, commercial, philosophical, ethical or political position regarding them. 

The "Invariant Sections" are certain Secondary Sections whose titles are designated, 
as being those of Invariant Sections, in the notice that says that the Document is released 
under this License. If a section does not fit the above definition of Secondary then it is not 
allowed to be designated as Invariant. The Document may contain zero Invariant Sections. 
If the Document does not identify any Invariant Sections then there are none. 

The "Cover Texts" are certain short passages of text that are listed, as Front-Cover Texts 
or Back-Cover Texts, in the notice that says that the Document is released under this Li- 
cense. A Front-Cover Text may be at most 5 words, and a Back-Cover Text may be at most 
25 words. 

A "Transparent" copy of the Document means a machine-readable copy, represented in 
a format whose specification is available to the general public, that is suitable for revising 
the document straightforwardly with generic text editors or (for images composed of pixels) 
generic paint programs or (for drawings) some widely available drawing editor, and that 
is suitable for input to text formatters or for automatic translation to a variety of formats 
suitable for input to text formatters. A copy made in an otherwise Transparent file format 
whose markup, or absence of markup, has been arranged to thwart or discourage subsequent 
modification by readers is not Transparent. An image format is not Transparent if used for 
any substantial amount of text. A copy that is not "Transparent" is called "Opaque". 

Examples of suitable formats for Transparent copies include plain ASCII without markup, 
Texinfo input format, LaTeX input format, SGML or XML using a publicly available DTD, 
and standard-conforming simple HTML, PostScript or PDF designed for human modifica- 
tion. Examples of transparent image formats include PNG, XCF and JPG. Opaque formats 
include proprietary formats that can be read and edited only by proprietary word proces- 
sors, SGML or XML for which the DTD and/or processing tools are not generally available, 
and the machine-generated HTML, PostScript or PDF produced by some word processors for 
output purposes only. 

The "Title Page" means, for a printed book, the title page itself, plus such following pages 
as are needed to hold, legibly, the material this License requires to appear in the title page. 
For works in formats which do not have any title page as such, "Title Page" means the text 
near the most prominent appearance of the work's title, preceding the beginning of the body 
of the text. 

A section "Entitled XYZ" means a named subunit of the Document whose title either 
is precisely XYZ or contains XYZ in parentheses following text that translates XYZ in an- 
other language. (Here XYZ stands for a specific section name mentioned below, such as 
"Acknowledgments", "Dedications", "Endorsements", or "History".) To "Preserve the 
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Title" of such a section when you modify the Document means that it remains a section 
"Entitled XYZ" according to this definition. 

The Document may include Warranty Disclaimers next to the notice which states that 
this License applies to the Document. These Warranty Disclaimers are considered to be 
included by reference in this License, but only as regards disclaiming warranties: any other 
implication that these Warranty Disclaimers may have is void and has no effect on the 
meaning of this License. 


2. VERBATIM COPYING 


You may copy and distribute the Document in any medium, either commercially or non- 
commercially, provided that this License, the copyright notices, and the license notice say- 
ing this License applies to the Document are reproduced in all copies, and that you add no 
other conditions whatsoever to those of this License. You may not use technical measures to 
obstruct or control the reading or further copying of the copies you make or distribute. How- 
ever, you may accept compensation in exchange for copies. If you distribute a large enough 
number of copies you must also follow the conditions in section 3. 

You may also lend copies, under the same conditions stated above, and you may publicly 
display copies. 


3. COPYING IN QUANTITY 


If you publish printed copies (or copies in media that commonly have printed covers) of 
the Document, numbering more than 100, and the Document’s license notice requires Cover 
Texts, you must enclose the copies in covers that carry, clearly and legibly, all these Cover 
Texts: Front-Cover Texts on the front cover, and Back-Cover Texts on the back cover. Both 
covers must also clearly and legibly identify you as the publisher of these copies. The front 
cover must present the full title with all words of the title equally prominent and visible. 
You may add other material on the covers in addition. Copying with changes limited to the 
covers, as long as they preserve the title of the Document and satisfy these conditions, can 
be treated as verbatim copying in other respects. 

If the required texts for either cover are too voluminous to fit legibly, you should put the 
first ones listed (as many as fit reasonably) on the actual cover, and continue the rest onto 
adjacent pages. 

If you publish or distribute Opaque copies of the Document numbering more than 100, 
you must either include a machine-readable Transparent copy along with each Opaque copy, 
or state in or with each Opaque copy a computer-network location from which the general 
network-using public has access to download using public-standard network protocols a com- 
plete Transparent copy of the Document, free of added material. If you use the latter option, 
you must take reasonably prudent steps, when you begin distribution of Opaque copies in 
quantity, to ensure that this Transparent copy will remain thus accessible at the stated lo- 
cation until at least one year after the last time you distribute an Opaque copy (directly or 
through your agents or retailers) of that edition to the public. 
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It is requested, but not required, that you contact the authors of the Document well before 
redistributing any large number of copies, to give them a chance to provide you with an 
updated version of the Document. 


4. MODIFICATIONS 


You may copy and distribute a Modified Version of the Document under the conditions of 
sections 2 and 3 above, provided that you release the Modified Version under precisely this 
License, with the Modified Version filling the role of the Document, thus licensing distribu- 
tion and modification of the Modified Version to whoever possesses a copy of it. In addition, 
you must do these things in the Modified Version: 


A. Useinthe Title Page (and on the covers, if any) a title distinct from that of the Document, 
and from those of previous versions (which should, if there were any, be listed in the 
History section of the Document). You may use the same title as a previous version if the 
original publisher of that version gives permission. 


B. List on the Title Page, as authors, one or more persons or entities responsible for au- 
thorship of the modifications in the Modified Version, together with at least five of the 
principal authors of the Document (all of its principal authors, if it has fewer than five), 
unless they release you from this requirement. 


C. State on the Title page the name of the publisher of the Modified Version, as the pub- 
lisher. 


D. Preserve all the copyright notices of the Document. 


E. Add an appropriate copyright notice for your modifications adjacent to the other copy- 
right notices. 


F. Include, immediately after the copyright notices, a license notice giving the public per- 
mission to use the Modified Version under the terms of this License, in the form shown 
in the Addendum below. 


G. Preserve in that license notice the full lists of Invariant Sections and required Cover 
Texts given in the Document’s license notice. 


H. Include an unaltered copy of this License. 


I. Preserve the section Entitled "History", Preserve its Title, and add to it an item stating 
at least the title, year, new authors, and publisher of the Modified Version as given on the 
Title Page. If there is no section Entitled "History" in the Document, create one stating 
the title, year, authors, and publisher of the Document as given on its Title Page, then 
add an item describing the Modified Version as stated in the previous sentence. 
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J. Preserve the network location, if any, given in the Document for public access to a Trans- 
parent copy of the Document, and likewise the network locations given in the Document 
for previous versions it was based on. These may be placed in the "History" section. You 
may omit a network location for a work that was published at least four years before the 
Document itself, or if the original publisher of the version it refers to gives permission. 


K. For any section Entitled "Acknowledgments" or "Dedications", Preserve the Title of the 
section, and preserve in the section all the substance and tone of each of the contributor 
acknowledgments and/or dedications given therein. 


L. Preserve all the Invariant Sections of the Document, unaltered in their text and in their 
titles. Section numbers or the equivalent are not considered part of the section titles. 


M. Delete any section Entitled "Endorsements". Such a section may not be included in the 
Modified Version. 


N. Do not retitle any existing section to be Entitled "Endorsements" or to conflict in title 
with any Invariant Section. 


O. Preserve any Warranty Disclaimers. 


If the Modified Version includes new front-matter sections or appendices that qualify as 
Secondary Sections and contain no material copied from the Document, you may at your 
option designate some or all of these sections as invariant. To do this, add their titles to 
the list of Invariant Sections in the Modified Version's license notice. These titles must be 
distinct from any other section titles. 

You may add a section Entitled "Endorsements", provided it contains nothing but endorse- 
ments of your Modified Version by various parties—for example, statements of peer review 
or that the text has been approved by an organization as the authoritative definition of a 
standard. 

You may add a passage of up to five words as a Front-Cover Text, and a passage of up to 
25 words as a Back-Cover Text, to the end of the list of Cover Texts in the Modified Version. 
Only one passage of Front-Cover Text and one of Back-Cover Text may be added by (or 
through arrangements made by) any one entity. If the Document already includes a cover 
text for the same cover, previously added by you or by arrangement made by the same entity 
you are acting on behalf of, you may not add another; but you may replace the old one, on 
explicit permission from the previous publisher that added the old one. 

The author(s) and publisher(s) of the Document do not by this License give permission to 
use their names for publicity for or to assert or imply endorsement of any Modified Version. 


5. COMBINING DOCUMENTS 


You may combine the Document with other documents released under this License, under 
the terms defined in section 4 above for modified versions, provided that you include in the 
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combination all of the Invariant Sections of all of the original documents, unmodified, and 
list them all as Invariant Sections of your combined work in its license notice, and that you 
preserve all their Warranty Disclaimers. 

The combined work need only contain one copy of this License, and multiple identical In- 
variant Sections may be replaced with a single copy. If there are multiple Invariant Sections 
with the same name but different contents, make the title of each such section unique by 
adding at the end of it, in parentheses, the name of the original author or publisher of that 
section if known, or else a unique number. Make the same adjustment to the section titles 
in the list of Invariant Sections in the license notice of the combined work. 

In the combination, you must combine any sections Entitled "History" in the various orig- 
inal documents, forming one section Entitled "History"; likewise combine any sections En- 
titled "Acknowledgments", and any sections Entitled "Dedications". You must delete all 
sections Entitled "Endorsements". 


6. COLLECTIONS OF DOCUMENTS 


You may make a collection consisting of the Document and other documents released un- 
der this License, and replace the individual copies of this License in the various documents 
with a single copy that is included in the collection, provided that you follow the rules of this 
License for verbatim copying of each of the documents in all other respects. 

You may extract a single document from such a collection, and distribute it individually 
under this License, provided you insert a copy of this License into the extracted document, 
and follow this License in all other respects regarding verbatim copying of that document. 


7. AGGREGATION WITH INDEPENDENT WORKS 


A compilation of the Document or its derivatives with other separate and independent 
documents or works, in or on a volume of a storage or distribution medium, is called an "ag- 
gregate" if the copyright resulting from the compilation is not used to limit the legal rights 
of the compilation's users beyond what the individual works permit. When the Document 
is included in an aggregate, this License does not apply to the other works in the aggregate 
which are not themselves derivative works of the Document. 

If the Cover Text requirement of section 3 is applicable to these copies of the Document, 
then if the Document is less than one half of the entire aggregate, the Document's Cover 
Texts may be placed on covers that bracket the Document within the aggregate, or the elec- 
tronic equivalent of covers if the Document is in electronic form. Otherwise they must ap- 
pear on printed covers that bracket the whole aggregate. 


8. TRANSLATION 


Translation is considered a kind of modification, so you may distribute translations of the 
Document under the terms of section 4. Replacing Invariant Sections with translations re- 
quires special permission from their copyright holders, but you may include translations of 
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some or all Invariant Sections in addition to the original versions of these Invariant Sections. 
You may include a translation of this License, and all the license notices in the Document, 
and any Warranty Disclaimers, provided that you also include the original English version 
of this License and the original versions of those notices and disclaimers. In case of a dis- 
agreement between the translation and the original version of this License or a notice or 
disclaimer, the original version will prevail. 

If a section in the Document is Entitled "Acknowledgments", "Dedications", or "History", 
the requirement (section 4) to Preserve its Title (section 1) will typically require changing 
the actual title. 


9. TERMINATION 


You may not copy, modify, sublicense, or distribute the Document except as expressly pro- 
vided for under this License. Any other attempt to copy, modify, sublicense or distribute the 
Document is void, and will automatically terminate your rights under this License. How- 
ever, parties who have received copies, or rights, from you under this License will not have 
their licenses terminated so long as such parties remain in full compliance. 


10. FUTURE REVISIONS OF THIS LICENSE 


The Free Software Foundation may publish new, revised versions of the GNU Free Doc- 
umentation License from time to time. Such new versions will be similar in spirit to the 
present version, but may differ in detail to address new problems or concerns. See http:// 
www.gnu.org/copyleft/. 

Each version of the License is given a distinguishing version number. If the Document 
specifies that a particular numbered version of this License "or any later version" applies to 
it, you have the option of following the terms and conditions either of that specified version or 
of any later version that has been published (not as a draft) by the Free Software Foundation. 
If the Document does not specify a version number of this License, you may choose any 
version ever published (not as a draft) by the Free Software Foundation. 


ADDENDUM: How to use this License for your documents 


To use this License in a document you have written, include a copy of the License in the 
document and put the following copyright and license notices just after the title page: 


Copyright ©YEAR YOUR NAME. Permission is granted to copy, distribute and/or 
modify this document under the terms of the GNU Free Documentation License, Ver- 
sion 1.2 or any later version published by the Free Software Foundation; with no 
Invariant Sections, no Front-Cover Texts, and no Back-Cover Texts. A copy of the 
license is included in the section entitled "GNU Free Documentation License". 
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If you have Invariant Sections, Front-Cover Texts and Back-Cover Texts, replace the 
"with...Texts." line with this: 


with the Invariant Sections being LIST THEIR TITLES, with the Front-Cover Texts 
being LIST, and with the Back-Cover Texts being LIST. 


If you have Invariant Sections without Cover Texts, or some other combination of the 
three, merge those two alternatives to suit the situation. 

If your document contains nontrivial examples of program code, we recommend releas- 
ing these examples in parallel under your choice of free software license, such as the GNU 
General Public License, to permit their use in free software. 


History 


This section contains the revision history of the book. For persons making modifications to 
the book, please record the pertinent information here, following the format in the first item 
below. 


1. 


VERSION: 1.0 

Date: 2008-01-04 

Author(s): Michael Corral 
Title: Vector Calculus 
Modification(s): Initial version 


. VERSION: 1.01 


Date: 2021-01-02 
Author(s): Michael Corral 
Title: Vector Calculus 


Modification(s): Fixed numerous typos and errors that had accumulated over the years. 


. VERSION: 1.02 


Date: 2022-05-11 
Author(s): Michael Corral 
Title: Vector Calculus 


Modification(s): Fixed a typo in the caption of Figure 1.2.8, as well as two typos in 
Appendix B. 
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